Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.748993ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=189830DD0EAB0A2D X-Request-Id=3RhqccTJvuS X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Fri, 27 Feb 2026 19:22:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1d54513ff9d1fd05
FAIL (2026-02-27 19:22:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830DD0EAB0A2D</RequestId><HostId></HostId></Error>"
Duration: 9.770578ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.188884ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:22:54 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189830DBDEA1CAAC X-Request-Id=4XJ9GSfBBTy target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6e0d6fb3fd7a4427
FAIL (2026-02-27 19:22:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830DBDEA1CAAC</RequestId><HostId></HostId></Error>"
Duration: 18.219571ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.890248ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189830D84CF7C469 X-Request-Id=ekoCmnPqWLj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:22:38 GMT Server=Storj Vary=Origin Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/75bc1887739de21f
FAIL (2026-02-27 19:22:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830D84CF7C469</RequestId><HostId></HostId></Error>"
Duration: 12.921446ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.138642356s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:22:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.138740932s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.274497ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=189830D5CB4925E9 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:22:28 GMT Accept-Ranges=bytes X-Request-Id=cVtNgsA8VQ5 Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3d7cf02b9f828152
FAIL (2026-02-27 19:22:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830D5CB4925E9</RequestId><HostId></HostId></Error>"
Duration: 28.299496ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.93411ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=189830D41D9D9913 X-Request-Id=GVZDhQEJrWQ X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:22:20 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/658f55733e92a2a5
FAIL (2026-02-27 19:22:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830D41D9D9913</RequestId><HostId></HostId></Error>"
Duration: 14.959984ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.451117ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189830CD8099836F X-Request-Id=NZPZU3xkR6Y X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:21:52 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5dcae12db88a5ba1
FAIL (2026-02-27 19:21:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830CD8099836F</RequestId><HostId></HostId></Error>"
Duration: 10.476797ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.433909ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=Uy1Ghy3bwwL X-Xss-Protection=1; mode=block Accept-Ranges=bytes X-Amz-Request-Id=189830CBAA7475BC Date=Fri, 27 Feb 2026 19:21:44 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/71a2a285463a6acc
FAIL (2026-02-27 19:21:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830CBAA7475BC</RequestId><HostId></HostId></Error>"
Duration: 10.457193ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.805019ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:21:43 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189830CB72725916 X-Request-Id=BMcKAoCnmhM target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2810ecaac983bc2e
FAIL (2026-02-27 19:21:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830CB72725916</RequestId><HostId></HostId></Error>"
Duration: 9.889409ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.142205393s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:21:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.142226775s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.233589ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189830C756C64B61 X-Request-Id=XEsXBe1wqrj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:21:26 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4eca2d51a3812696
FAIL (2026-02-27 19:21:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830C756C64B61</RequestId><HostId></HostId></Error>"
Duration: 9.263366ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.743734ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 19:21:23 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=BorhdpJzfmU X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189830C6B93942CC target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2a952c0ea6c329fe
FAIL (2026-02-27 19:21:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830C6B93942CC</RequestId><HostId></HostId></Error>"
Duration: 29.766725ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.546573ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:21:18 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189830C5AA4FE656 X-Request-Id=ffN1Lq5tHf8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/44f07b76926a203c
FAIL (2026-02-27 19:21:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830C5AA4FE656</RequestId><HostId></HostId></Error>"
Duration: 14.584774ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.446688ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=189830C1683DCC3A X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:21:00 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=A7Lk3vNuf9h Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/396285b46a49b675
FAIL (2026-02-27 19:21:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830C1683DCC3A</RequestId><HostId></HostId></Error>"
Duration: 10.470852ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.57667ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:20:58 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189830C0E859136F X-Request-Id=MardY745DXg target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7995aab7f69ab8af
FAIL (2026-02-27 19:20:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830C0E859136F</RequestId><HostId></HostId></Error>"
Duration: 11.633123ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.064694247s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:20:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.064724087s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.412257ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 X-Request-Id=j8ZRFcDaoRL Date=Fri, 27 Feb 2026 19:20:33 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189830BB189832AC X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/20a916301ab97c0f
FAIL (2026-02-27 19:20:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830BB189832AC</RequestId><HostId></HostId></Error>"
Duration: 14.439485ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.663333ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189830B9C5CE20F1 Server=Storj X-Request-Id=MU6zgcsimqA X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:20:27 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/32c168dfcab4cfda
FAIL (2026-02-27 19:20:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830B9C5CE20F1</RequestId><HostId></HostId></Error>"
Duration: 31.688876ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.498848ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml X-Request-Id=FAWtRvoFyth Date=Fri, 27 Feb 2026 19:20:18 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189830B7A60EC50E X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/173a0a3fbf0bcf2d
FAIL (2026-02-27 19:20:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830B7A60EC50E</RequestId><HostId></HostId></Error>"
Duration: 12.524917ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.164508205s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:20:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.164542734s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
37.779108ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189830B395CF63A3 Date=Fri, 27 Feb 2026 19:20:01 GMT Content-Security-Policy=block-all-mixed-content X-Request-Id=2sdUnSkRVme X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/45c2e9ece5bcd88c
FAIL (2026-02-27 19:20:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830B395CF63A3</RequestId><HostId></HostId></Error>"
Duration: 37.880068ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.874329ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189830B0934F3D21 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=XkLzXvx1xVE X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:19:48 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/53488e80574e0222
FAIL (2026-02-27 19:19:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830B0934F3D21</RequestId><HostId></HostId></Error>"
Duration: 14.90494ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.211132ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189830AA04AD6369 X-Request-Id=et8NJxz7exP X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Date=Fri, 27 Feb 2026 19:19:20 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/68cd5cec4b28d2f
FAIL (2026-02-27 19:19:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830AA04AD6369</RequestId><HostId></HostId></Error>"
Duration: 10.236101ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.056836189s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:19:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.056872969s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.585217ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 19:19:14 GMT Content-Length=284 X-Amz-Request-Id=189830A8985AB27F X-Request-Id=ipT5qn68EY8 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/26e7da7bb4106685
FAIL (2026-02-27 19:19:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830A8985AB27F</RequestId><HostId></HostId></Error>"
Duration: 28.609246ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.705321ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189830A7994F57EC X-Request-Id=GDtfcyhHba4 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Date=Fri, 27 Feb 2026 19:19:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/36252a64d19cf501
FAIL (2026-02-27 19:19:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830A7994F57EC</RequestId><HostId></HostId></Error>"
Duration: 9.731832ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.086693808s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:18:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.086786143s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.971914ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Vary=Origin X-Amz-Request-Id=189830A2909FFD86 X-Request-Id=18B5z7FbLni Date=Fri, 27 Feb 2026 19:18:48 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/285ca4f6ab1675e2
FAIL (2026-02-27 19:18:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830A2909FFD86</RequestId><HostId></HostId></Error>"
Duration: 13.9956ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
36.015953ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898309DA474A69D X-Request-Id=iSEAjKZoMct X-Xss-Protection=1; mode=block Content-Length=284 Date=Fri, 27 Feb 2026 19:18:26 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4636d1ae5226e2e1
FAIL (2026-02-27 19:18:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898309DA474A69D</RequestId><HostId></HostId></Error>"
Duration: 36.031415ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.102055803s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:18:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.102200754s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.687552ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898309D350926F9 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:18:25 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=JyGj8ESbBJb target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3224e74349102832
FAIL (2026-02-27 19:18:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898309D350926F9</RequestId><HostId></HostId></Error>"
Duration: 11.712067ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.626121ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898309A3D53CC28 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:18:12 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=8fLkhwACKZJ Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6c166a9c248a4557
FAIL (2026-02-27 19:18:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898309A3D53CC28</RequestId><HostId></HostId></Error>"
Duration: 9.649388ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.569405ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898309745B8D5F5 X-Request-Id=dZvtnfiVLfV Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:17:59 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7b679d0d4250d5ca
FAIL (2026-02-27 19:17:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898309745B8D5F5</RequestId><HostId></HostId></Error>"
Duration: 14.592509ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.369435ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=DhiHChMoLQW Date=Fri, 27 Feb 2026 19:17:37 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189830921FB50D69 X-Xss-Protection=1; mode=block Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/364517c3415213d
FAIL (2026-02-27 19:17:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830921FB50D69</RequestId><HostId></HostId></Error>"
Duration: 10.396166ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.443128ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898309198E6BFB6 X-Request-Id=dMtPxb1f8jb X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:17:35 GMT Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5b7aa5b99d4e5764
FAIL (2026-02-27 19:17:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898309198E6BFB6</RequestId><HostId></HostId></Error>"
Duration: 9.471555ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.109699988s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:17:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.109732s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.00026ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898308E70A66779 Date=Fri, 27 Feb 2026 19:17:21 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=Kx5dDUuYToh X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/41788cadf3f36693
FAIL (2026-02-27 19:17:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898308E70A66779</RequestId><HostId></HostId></Error>"
Duration: 11.028341ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.663049ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=USrwHj3pkme X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898308E26E230B3 Date=Fri, 27 Feb 2026 19:17:20 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/769e2d4c1d72018a
FAIL (2026-02-27 19:17:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898308E26E230B3</RequestId><HostId></HostId></Error>"
Duration: 8.688672ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.762793ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj X-Request-Id=KmQ7PBLc5CU Date=Fri, 27 Feb 2026 19:17:15 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898308D07ED59DD X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/27a47d7ff77e75c8
FAIL (2026-02-27 19:17:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898308D07ED59DD</RequestId><HostId></HostId></Error>"
Duration: 28.792852ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.414847ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:16:57 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Vary=Origin X-Amz-Request-Id=18983088C6348866 X-Request-Id=z2nF6v8ek3 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5dc06026625fc4ad
FAIL (2026-02-27 19:16:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983088C6348866</RequestId><HostId></HostId></Error>"
Duration: 12.434492ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.112297034s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:16:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.112327518s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.971503ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189830838A7F0C6E X-Request-Id=WtiSzNgyjUT X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:16:34 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3e87be75519ff837
FAIL (2026-02-27 19:16:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830838A7F0C6E</RequestId><HostId></HostId></Error>"
Duration: 26.997247ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.460481ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:16:34 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=XP3SP6nWQo9 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898308387811981 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/45f1137485b192b9
FAIL (2026-02-27 19:16:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898308387811981</RequestId><HostId></HostId></Error>"
Duration: 9.488325ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.136125ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=GePbiJnLR6X X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898308174B4BD09 Date=Fri, 27 Feb 2026 19:16:25 GMT Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2942017ff6cddc9f
FAIL (2026-02-27 19:16:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898308174B4BD09</RequestId><HostId></HostId></Error>"
Duration: 11.161104ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.083530127s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:16:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.083566347s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.720631ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898307D334A7DD0 X-Request-Id=gpENsSiZcNE X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:16:07 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/54ca8c5017b8caad
FAIL (2026-02-27 19:16:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898307D334A7DD0</RequestId><HostId></HostId></Error>"
Duration: 11.744883ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.784229ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898307BA4BA9289 X-Request-Id=RAFnhHbMbEU X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:16:00 GMT Content-Length=284 Content-Type=application/xml Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/122ecdc2e01bb315
FAIL (2026-02-27 19:16:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898307BA4BA9289</RequestId><HostId></HostId></Error>"
Duration: 28.810701ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.681688ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:15:58 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898307B1C138913 X-Request-Id=XRuauBBCP5H X-Xss-Protection=1; mode=block Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/41fcef88cba57167
FAIL (2026-02-27 19:15:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898307B1C138913</RequestId><HostId></HostId></Error>"
Duration: 12.713353ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.587604ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Request-Id=DjTL61fJZAv Date=Fri, 27 Feb 2026 19:15:47 GMT Server=Storj Vary=Origin X-Amz-Request-Id=1898307882348A7C X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/22cd059ef4744ef6
FAIL (2026-02-27 19:15:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898307882348A7C</RequestId><HostId></HostId></Error>"
Duration: 10.616186ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.481574ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=JcDZcdz8NTz X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=189830776FE1852A Date=Fri, 27 Feb 2026 19:15:42 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/319faf9d5c9783fa
FAIL (2026-02-27 19:15:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830776FE1852A</RequestId><HostId></HostId></Error>"
Duration: 11.582257ms
edge
gateway
vhost
bgp
eu1
|