Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.92766ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Vary=Origin X-Amz-Request-Id=189830749C839024 X-Request-Id=KB2GaaVvEwx Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:15:30 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/61cc58182f09f047
FAIL (2026-02-27 19:15:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830749C839024</RequestId><HostId></HostId></Error>"
Duration: 12.02045ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.137863ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189830733F11BABB X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:15:24 GMT Content-Length=274 X-Request-Id=5gTzacxc82u target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6a79fabb201eec32
FAIL (2026-02-27 19:15:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830733F11BABB</RequestId><HostId></HostId></Error>"
Duration: 11.159999ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.356277ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898307305EE56D5 X-Request-Id=MhmWgcmbDi8 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:15:23 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4d3f4ca90541dba1
FAIL (2026-02-27 19:15:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898307305EE56D5</RequestId><HostId></HostId></Error>"
Duration: 28.382134ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.093282935s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:15:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.093323943s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.22208ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=G1y7dXfFa4r Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:15:04 GMT Accept-Ranges=bytes X-Amz-Request-Id=1898306E90E9464A target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5008dfe124934ce7
FAIL (2026-02-27 19:15:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898306E90E9464A</RequestId><HostId></HostId></Error>"
Duration: 15.249719ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
39.759608ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898306E449F28F6 X-Request-Id=48p3QoY8V5R X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:15:03 GMT Accept-Ranges=bytes Server=Storj Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/577234e058a4e769
FAIL (2026-02-27 19:15:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898306E449F28F6</RequestId><HostId></HostId></Error>"
Duration: 39.816987ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.171064ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189830694A4EA12F X-Request-Id=G28xWbt78RD X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj Date=Fri, 27 Feb 2026 19:14:42 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1922dc26158aa305
FAIL (2026-02-27 19:14:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830694A4EA12F</RequestId><HostId></HostId></Error>"
Duration: 12.183496ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.807012ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=18983067F42DAF57 X-Request-Id=fK4mPNSUE1R X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:14:36 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1a20e18088a6ad6e
FAIL (2026-02-27 19:14:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983067F42DAF57</RequestId><HostId></HostId></Error>"
Duration: 8.836762ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.385057ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=hg5L8uHw5bT X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:14:35 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18983067C848DED5 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7d71d8496d35824
FAIL (2026-02-27 19:14:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983067C848DED5</RequestId><HostId></HostId></Error>"
Duration: 33.402244ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.092109ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 19:14:21 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898306482F1143E X-Request-Id=bQajXsCV8wL X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/71864789f28f331c
FAIL (2026-02-27 19:14:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898306482F1143E</RequestId><HostId></HostId></Error>"
Duration: 12.121148ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.983371ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:14:13 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18983062AE09CF92 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Request-Id=PFsw6ZrRuFC target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6d8b54c10e9f0edb
FAIL (2026-02-27 19:14:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983062AE09CF92</RequestId><HostId></HostId></Error>"
Duration: 9.009143ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.105140569s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:14:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.105171192s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.555255ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Vary=Origin X-Amz-Request-Id=189830607F1ACA96 X-Request-Id=E6z1prdaSr7 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 19:14:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4bb1d95ce6d72898
FAIL (2026-02-27 19:14:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830607F1ACA96</RequestId><HostId></HostId></Error>"
Duration: 12.581068ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.856652ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898305FBCACF456 X-Request-Id=FD6HKiHkqGN X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:14:01 GMT Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/47cbbd910af659d9
FAIL (2026-02-27 19:14:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898305FBCACF456</RequestId><HostId></HostId></Error>"
Duration: 27.937653ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.863517ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1898305F1FE7578F X-Request-Id=SaDPahX1Xbw Date=Fri, 27 Feb 2026 19:13:58 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/569e678f73198edd
FAIL (2026-02-27 19:13:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898305F1FE7578F</RequestId><HostId></HostId></Error>"
Duration: 10.900903ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.079426043s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:13:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.079455083s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.360156ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=b5hWVbsUU5a X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189830563FF8EB57 Date=Fri, 27 Feb 2026 19:13:20 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/17685371520f4380
FAIL (2026-02-27 19:13:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830563FF8EB57</RequestId><HostId></HostId></Error>"
Duration: 11.388882ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.092698392s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:13:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.092726549s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.9862ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=KCQkSbue5V2 X-Xss-Protection=1; mode=block Content-Type=application/xml X-Amz-Request-Id=18983051B0131ADC Date=Fri, 27 Feb 2026 19:13:00 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/c59da96e76788b2
FAIL (2026-02-27 19:13:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983051B0131ADC</RequestId><HostId></HostId></Error>"
Duration: 11.011102ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.390517ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Vary=Origin Date=Fri, 27 Feb 2026 19:12:59 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189830514F1CE52C X-Request-Id=EDZU39rnn1E X-Xss-Protection=1; mode=block Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4332caa7201a338c
FAIL (2026-02-27 19:12:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830514F1CE52C</RequestId><HostId></HostId></Error>"
Duration: 30.418014ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.632187ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=cAh5LC1YZvf X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:12:44 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898304DD39B0011 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/14e22b2365252e9c
FAIL (2026-02-27 19:12:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304DD39B0011</RequestId><HostId></HostId></Error>"
Duration: 11.724799ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.876899ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1898304DE7B4F863 X-Request-Id=FzPWzfiTr3n Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:12:44 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/73882ca6fad5f753
FAIL (2026-02-27 19:12:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304DE7B4F863</RequestId><HostId></HostId></Error>"
Duration: 9.90582ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.501526ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898304D5ABE713A X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=7BhSCTXddCz Date=Fri, 27 Feb 2026 19:12:42 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/616b7e13ae134e85
FAIL (2026-02-27 19:12:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304D5ABE713A</RequestId><HostId></HostId></Error>"
Duration: 10.525635ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.077033169s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:12:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.077084024s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.018495ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes X-Request-Id=NLjhZhszjpV Date=Fri, 27 Feb 2026 19:12:33 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898304B520EEAF9 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6fcaca60273e800d
FAIL (2026-02-27 19:12:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304B520EEAF9</RequestId><HostId></HostId></Error>"
Duration: 30.045704ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.762315ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 19:12:25 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189830496644F43F X-Request-Id=NcACVVyiKrx X-Xss-Protection=1; mode=block Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/60ffe3b3f0d4a183
FAIL (2026-02-27 19:12:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830496644F43F</RequestId><HostId></HostId></Error>"
Duration: 11.786112ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.21585ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:12:17 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=QGJGtvmpfuo X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18983047A5C82C7F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/54574e481bcf8157
FAIL (2026-02-27 19:12:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983047A5C82C7F</RequestId><HostId></HostId></Error>"
Duration: 11.243318ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.068179ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=18983043F4A71D30 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:12:01 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=eCgbHBzqnoc target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7b3da4579add983b
FAIL (2026-02-27 19:12:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983043F4A71D30</RequestId><HostId></HostId></Error>"
Duration: 13.098761ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.05725854s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:11:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057290582s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.165678ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898303E485EB7A8 X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj X-Request-Id=YUnzKCaoQzE Date=Fri, 27 Feb 2026 19:11:37 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/417c9dd5f966290a
FAIL (2026-02-27 19:11:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303E485EB7A8</RequestId><HostId></HostId></Error>"
Duration: 11.196864ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.725197ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=Hfzd3GfLZ1k X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:11:31 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898303CE88A4A94 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1dfbf23590eade61
FAIL (2026-02-27 19:11:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303CE88A4A94</RequestId><HostId></HostId></Error>"
Duration: 9.751219ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.4294ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:11:25 GMT Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1898303B9556F318 X-Request-Id=6d2cQ5eQAZd Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/142e5f904e548384
FAIL (2026-02-27 19:11:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303B9556F318</RequestId><HostId></HostId></Error>"
Duration: 27.475507ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.40877ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1898303B80B2E2BA X-Request-Id=iv9ecSPoYsa Date=Fri, 27 Feb 2026 19:11:25 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1f4c5f0f1c6eeb47
FAIL (2026-02-27 19:11:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303B80B2E2BA</RequestId><HostId></HostId></Error>"
Duration: 10.431745ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.172597628s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:11:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.172632509s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.930086ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Fri, 27 Feb 2026 19:11:03 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=1898303670DAC9AC X-Request-Id=Jc6gmLmg5AB X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/14398a5114ffdb77
FAIL (2026-02-27 19:11:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303670DAC9AC</RequestId><HostId></HostId></Error>"
Duration: 11.953915ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.271697ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189830330DA61115 X-Request-Id=KGr1PVNEks8 Date=Fri, 27 Feb 2026 19:10:49 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/316b809bf64e4202
FAIL (2026-02-27 19:10:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830330DA61115</RequestId><HostId></HostId></Error>"
Duration: 10.314254ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.428897ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18983032F491B5FA X-Request-Id=8VJdiQNAU2A X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 19:10:48 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3cc7109cd4c156c1
FAIL (2026-02-27 19:10:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983032F491B5FA</RequestId><HostId></HostId></Error>"
Duration: 30.451829ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.114821727s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:10:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.114854395s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.574747ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898302BCF445FE2 X-Request-Id=PjbbuASeY8y Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:10:18 GMT Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/48a8ec629a911d69
FAIL (2026-02-27 19:10:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898302BCF445FE2</RequestId><HostId></HostId></Error>"
Duration: 10.597609ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.418745ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189830291BDDAEF9 X-Request-Id=4Db9RZQB8ox Date=Fri, 27 Feb 2026 19:10:06 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3e1e4c538a296697
FAIL (2026-02-27 19:10:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830291BDDAEF9</RequestId><HostId></HostId></Error>"
Duration: 11.482253ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.061074ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18983027CA81F610 X-Request-Id=SLL3m7FB2Ru Date=Fri, 27 Feb 2026 19:10:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/336af2bf7178584b
FAIL (2026-02-27 19:10:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983027CA81F610</RequestId><HostId></HostId></Error>"
Duration: 11.102171ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.364302ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189830265B8BF917 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:09:54 GMT Accept-Ranges=bytes Content-Length=274 X-Request-Id=AnCxiWHhXM7 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3f6eb92d15ad737d
FAIL (2026-02-27 19:09:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830265B8BF917</RequestId><HostId></HostId></Error>"
Duration: 12.392514ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.390649ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18983024DBD4A3A8 X-Request-Id=SqYMVufPNqR X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 19:09:48 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/13d062eae4dddc62
FAIL (2026-02-27 19:09:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983024DBD4A3A8</RequestId><HostId></HostId></Error>"
Duration: 30.42993ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.057800459s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:09:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057864476s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.784845ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=L2Er9Z74PRm X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:09:38 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18983022AA2E9922 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7a6b558b3a999a12
FAIL (2026-02-27 19:09:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983022AA2E9922</RequestId><HostId></HostId></Error>"
Duration: 10.809228ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.093223ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18983021178AB868 X-Request-Id=9pNP8b5qyaE Date=Fri, 27 Feb 2026 19:09:32 GMT Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/e91227e43ea56b8
FAIL (2026-02-27 19:09:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983021178AB868</RequestId><HostId></HostId></Error>"
Duration: 9.113611ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.304063ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:09:26 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=EctJH6cEGA9 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898301FE1CE0418 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/46ebf0b449f90ff6
FAIL (2026-02-27 19:09:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898301FE1CE0418</RequestId><HostId></HostId></Error>"
Duration: 10.334575ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.057952028s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:09:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057992296s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.109764ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898301788FD547B X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=hhkXJnddTJ7 Date=Fri, 27 Feb 2026 19:08:51 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4a9eb249d4573622
FAIL (2026-02-27 19:08:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898301788FD547B</RequestId><HostId></HostId></Error>"
Duration: 15.197603ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.228777ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 19:08:47 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18983016AD17BE05 X-Request-Id=8h99dWWpT4q Content-Length=284 Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/47923e3700106f54
FAIL (2026-02-27 19:08:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983016AD17BE05</RequestId><HostId></HostId></Error>"
Duration: 28.261677ms
edge
gateway
vhost
us-select-1
|