Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.04044ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=CyhyGrddHLY X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:43:54 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=189832014BA8750E Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/59340da732d5d30d
FAIL (2026-02-27 19:43:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189832014BA8750E</RequestId><HostId></HostId></Error>"
Duration: 11.072276ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.549339ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189831FE5836F7BB X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:43:41 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Request-Id=auG9JqzudEQ Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6b8594f556627ed1
FAIL (2026-02-27 19:43:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831FE5836F7BB</RequestId><HostId></HostId></Error>"
Duration: 13.586385ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.090004221s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:43:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.090045923s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.421129ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189831FB819B9C38 X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=fnwM2Fj4vt7 Date=Fri, 27 Feb 2026 19:43:29 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/56d79353560a692c
FAIL (2026-02-27 19:43:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831FB819B9C38</RequestId><HostId></HostId></Error>"
Duration: 10.454426ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.135586ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189831FA8DC59E99 X-Request-Id=TctFBH9fDRD X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:43:25 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6afd60465f5b25d2
FAIL (2026-02-27 19:43:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831FA8DC59E99</RequestId><HostId></HostId></Error>"
Duration: 31.152981ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.666884ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189831F7219A8AA4 X-Request-Id=P846nVtrjjN Date=Fri, 27 Feb 2026 19:43:10 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5ecb8ffb0e400a9a
FAIL (2026-02-27 19:43:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831F7219A8AA4</RequestId><HostId></HostId></Error>"
Duration: 10.703492ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.279299ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189831F6B5430568 X-Request-Id=bRdVkZoxu1V X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 19:43:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2f788f394367a63f
FAIL (2026-02-27 19:43:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831F6B5430568</RequestId><HostId></HostId></Error>"
Duration: 9.316721ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.134454ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=P8dRk5GXcFB X-Xss-Protection=1; mode=block Content-Length=274 Vary=Origin X-Amz-Request-Id=189831F3BB81CBF3 Date=Fri, 27 Feb 2026 19:42:56 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/25aafc9400d14b62
FAIL (2026-02-27 19:42:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831F3BB81CBF3</RequestId><HostId></HostId></Error>"
Duration: 14.153308ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.600077ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189831EFE854C7B2 X-Request-Id=KHDMAgW9HAe Accept-Ranges=bytes Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:42:39 GMT Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/653dae7cf9199da4
FAIL (2026-02-27 19:42:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831EFE854C7B2</RequestId><HostId></HostId></Error>"
Duration: 29.650073ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.172504ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=Ta7UUPjzGeN Content-Length=274 X-Amz-Request-Id=189831ED884DAAE9 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:42:29 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/79156fd486c9accf
FAIL (2026-02-27 19:42:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831ED884DAAE9</RequestId><HostId></HostId></Error>"
Duration: 9.208332ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.484556ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189831ED62A8849D X-Request-Id=bEiPR7NvA8H X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj Date=Fri, 27 Feb 2026 19:42:29 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/14b968c3cc3b5979
FAIL (2026-02-27 19:42:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831ED62A8849D</RequestId><HostId></HostId></Error>"
Duration: 11.550853ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.22265001s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:42:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.222677287s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.965472ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189831E92EF1649A X-Request-Id=MMVKyy8aPHn X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:42:10 GMT Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/230ba1656f108bf9
FAIL (2026-02-27 19:42:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831E92EF1649A</RequestId><HostId></HostId></Error>"
Duration: 9.990129ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.872645ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189831E8E5B1CDFE X-Request-Id=cRh2SrG7QLG X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Vary=Origin Date=Fri, 27 Feb 2026 19:42:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2e29a0e43d2af3bc
FAIL (2026-02-27 19:42:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831E8E5B1CDFE</RequestId><HostId></HostId></Error>"
Duration: 10.908386ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.372534ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=1ATUUgWTXqm Date=Fri, 27 Feb 2026 19:42:07 GMT Server=Storj X-Amz-Request-Id=189831E855F6738A X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/481a4a6173689083
FAIL (2026-02-27 19:42:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831E855F6738A</RequestId><HostId></HostId></Error>"
Duration: 12.402669ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.255519ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=5sMuPbnm1C1 Date=Fri, 27 Feb 2026 19:41:43 GMT Vary=Origin X-Amz-Request-Id=189831E2C4B9C990 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7f23b748e61de951
FAIL (2026-02-27 19:41:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831E2C4B9C990</RequestId><HostId></HostId></Error>"
Duration: 27.278855ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.612175ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:41:43 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=189831E2D9ED8A1C X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=19tmwTQ9itQ target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/77ba6249b20c4ecf
FAIL (2026-02-27 19:41:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831E2D9ED8A1C</RequestId><HostId></HostId></Error>"
Duration: 11.641008ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.295207ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189831E1669E046A X-Request-Id=QdNPU5geRXR Date=Fri, 27 Feb 2026 19:41:37 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/726f02a742981da7
FAIL (2026-02-27 19:41:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831E1669E046A</RequestId><HostId></HostId></Error>"
Duration: 11.381211ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.71416ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:41:16 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes X-Amz-Request-Id=189831DC6D44B1C7 X-Request-Id=hf4bHiSJb25 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3ce67f7095697fb3
FAIL (2026-02-27 19:41:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831DC6D44B1C7</RequestId><HostId></HostId></Error>"
Duration: 8.73936ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.074117ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189831DC15EF7464 Date=Fri, 27 Feb 2026 19:41:14 GMT Content-Security-Policy=block-all-mixed-content X-Request-Id=GS4QRgJQScf X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5a8bd36d65afe9bb
FAIL (2026-02-27 19:41:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831DC15EF7464</RequestId><HostId></HostId></Error>"
Duration: 16.100249ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.094162379s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:41:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.094206597s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.15587ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=189831D87D488AA8 X-Request-Id=QTqyQ16wnDi X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 19:40:59 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4400d45f46051930
FAIL (2026-02-27 19:40:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831D87D488AA8</RequestId><HostId></HostId></Error>"
Duration: 29.179426ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.044265658s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:40:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.044292118s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.021351ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189831D65FED80A2 X-Xss-Protection=1; mode=block Server=Storj X-Request-Id=46cemx2PfhB Date=Fri, 27 Feb 2026 19:40:50 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1ee9739c081e6aa1
FAIL (2026-02-27 19:40:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831D65FED80A2</RequestId><HostId></HostId></Error>"
Duration: 11.051526ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.842552ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=189831D034E20BD4 X-Request-Id=WEKAbSfCuEX X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:40:23 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/431d8069fd0713af
FAIL (2026-02-27 19:40:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831D034E20BD4</RequestId><HostId></HostId></Error>"
Duration: 9.86904ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.697729ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189831CF25E39F9E X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Request-Id=QBzBrYTV5Rh Date=Fri, 27 Feb 2026 19:40:19 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/137c740cb68e01d8
FAIL (2026-02-27 19:40:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831CF25E39F9E</RequestId><HostId></HostId></Error>"
Duration: 10.725534ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.656856ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189831CEDB8CFC49 X-Request-Id=QUQMaQu5GyN Date=Fri, 27 Feb 2026 19:40:17 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/27589147e1056606
FAIL (2026-02-27 19:40:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831CEDB8CFC49</RequestId><HostId></HostId></Error>"
Duration: 13.684938ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.090880289s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:40:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.090915719s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.773665ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=Z9SeQauHYwb Date=Fri, 27 Feb 2026 19:40:09 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189831CCEFE7B973 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3d04984454798613
FAIL (2026-02-27 19:40:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831CCEFE7B973</RequestId><HostId></HostId></Error>"
Duration: 28.803903ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.076813421s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:39:47 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.076841798s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.514049ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:39:39 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189831C600A489A7 Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=ALN5ZTsnpNV X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/34fe379921513d10
FAIL (2026-02-27 19:39:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831C600A489A7</RequestId><HostId></HostId></Error>"
Duration: 10.552016ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.479745ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189831C480678CCB Content-Security-Policy=block-all-mixed-content X-Request-Id=iHg3enFNqRY X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:39:33 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/186bbff3cc3632f3
FAIL (2026-02-27 19:39:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831C480678CCB</RequestId><HostId></HostId></Error>"
Duration: 28.520486ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.724497ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=DyRoiKR2M6T X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189831C2BA95FC33 Date=Fri, 27 Feb 2026 19:39:25 GMT Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/743e820301318cd5
FAIL (2026-02-27 19:39:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831C2BA95FC33</RequestId><HostId></HostId></Error>"
Duration: 9.752542ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.611135ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189831C045CA4DCE X-Request-Id=9xJr1kReBBu Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:39:15 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/24565380cb94a3a0
FAIL (2026-02-27 19:39:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831C045CA4DCE</RequestId><HostId></HostId></Error>"
Duration: 18.671349ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.541555ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj X-Amz-Request-Id=189831BE037390FE Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=hJxkwEtJx45 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:39:05 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/791e4745b36710fa
FAIL (2026-02-27 19:39:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831BE037390FE</RequestId><HostId></HostId></Error>"
Duration: 32.576311ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.016688ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=cABwwQs6QpZ X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189831B942A56107 Date=Fri, 27 Feb 2026 19:38:45 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/66e1ea94658e40f
FAIL (2026-02-27 19:38:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831B942A56107</RequestId><HostId></HostId></Error>"
Duration: 10.044238ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.078751121s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:38:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.078849163s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.245513ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=189831B68902E718 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=cqQwWXcwBgA X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:38:33 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/32833a0bfb12801e
FAIL (2026-02-27 19:38:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831B68902E718</RequestId><HostId></HostId></Error>"
Duration: 11.276721ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.702884ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189831B557C270B2 X-Request-Id=JpkuDZsTUF5 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:38:28 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/54a2094464ec69d7
FAIL (2026-02-27 19:38:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831B557C270B2</RequestId><HostId></HostId></Error>"
Duration: 8.729376ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
39.029977ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:38:23 GMT Server=Storj Vary=Origin X-Amz-Request-Id=189831B44DFE2FFC X-Request-Id=5bRVfvW9tvH Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/54cac2c96d35c150
FAIL (2026-02-27 19:38:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831B44DFE2FFC</RequestId><HostId></HostId></Error>"
Duration: 39.046324ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.828637ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189831B2D5E4474C Accept-Ranges=bytes Vary=Origin X-Request-Id=HLhRmyjbJ9B X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:38:17 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/458916fcb2e1ddd2
FAIL (2026-02-27 19:38:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831B2D5E4474C</RequestId><HostId></HostId></Error>"
Duration: 27.950024ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.169812ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189831AFF3B60F12 Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=38SELWFsLMU X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:38:05 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4c5654c4efb21d5e
FAIL (2026-02-27 19:38:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831AFF3B60F12</RequestId><HostId></HostId></Error>"
Duration: 15.202147ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.706744ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block X-Amz-Request-Id=189831AB6A5BB6AB Date=Fri, 27 Feb 2026 19:37:45 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=ERw6uCQG2Sw target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5a63399250754c68
FAIL (2026-02-27 19:37:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831AB6A5BB6AB</RequestId><HostId></HostId></Error>"
Duration: 29.73382ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.122239111s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:37:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.122272386s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.089146ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=eare4dvq2E6 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:37:37 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189831A98F3897FE Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2828225f1cd823b6
FAIL (2026-02-27 19:37:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831A98F3897FE</RequestId><HostId></HostId></Error>"
Duration: 10.174461ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.147697ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=189831A7EA69FBBF X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:37:30 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=F3FJ7cbiQbH target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/45cd765bed1e8dbe
FAIL (2026-02-27 19:37:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831A7EA69FBBF</RequestId><HostId></HostId></Error>"
Duration: 10.172041ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.795859ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189831A51E17A063 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:37:18 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=9fqpbgGYpN4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1944fd47496cee32
FAIL (2026-02-27 19:37:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831A51E17A063</RequestId><HostId></HostId></Error>"
Duration: 14.817586ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.122177ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=189831A1686340AF X-Request-Id=gyKJPEYvjBA Date=Fri, 27 Feb 2026 19:37:02 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/214975086cea9020
FAIL (2026-02-27 19:37:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189831A1686340AF</RequestId><HostId></HostId></Error>"
Duration: 30.161658ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.107178879s trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:36:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032 , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042 , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038 , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025 , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030 , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034 , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047 , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033 , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024 , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017 , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029 , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004 , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010 , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001 , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023 , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.107229057s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.749482ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:36:45 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=1898319D54B39347 X-Request-Id=VwhaqnacLDg target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2dd01fcc638a5bc3
FAIL (2026-02-27 19:36:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898319D54B39347</RequestId><HostId></HostId></Error>"
Duration: 9.814891ms
edge
gateway
vhost
bgp
eu1
|