Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 333205 reports (Page 1787 of 6665)
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.92766ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Vary=Origin
X-Amz-Request-Id=189830749C839024
X-Request-Id=KB2GaaVvEwx
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:15:30 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/61cc58182f09f047
FAIL (2026-02-27 19:15:30 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830749C839024</RequestId><HostId></HostId></Error>"
Duration: 12.02045ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.137863ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=189830733F11BABB
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:15:24 GMT
Content-Length=274
X-Request-Id=5gTzacxc82u
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6a79fabb201eec32
FAIL (2026-02-27 19:15:24 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830733F11BABB</RequestId><HostId></HostId></Error>"
Duration: 11.159999ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
28.356277ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Length=284
Content-Type=application/xml
Server=Storj
Vary=Origin
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=1898307305EE56D5
X-Request-Id=MhmWgcmbDi8
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:15:23 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/4d3f4ca90541dba1
FAIL (2026-02-27 19:15:23 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898307305EE56D5</RequestId><HostId></HostId></Error>"
Duration: 28.382134ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
2.093282935s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:15:13 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.093323943s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
15.22208ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=G1y7dXfFa4r
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:15:04 GMT
Accept-Ranges=bytes
X-Amz-Request-Id=1898306E90E9464A
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/5008dfe124934ce7
FAIL (2026-02-27 19:15:04 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898306E90E9464A</RequestId><HostId></HostId></Error>"
Duration: 15.249719ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
39.759608ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=1898306E449F28F6
X-Request-Id=48p3QoY8V5R
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:15:03 GMT
Accept-Ranges=bytes
Server=Storj
Content-Length=284
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/577234e058a4e769
FAIL (2026-02-27 19:15:03 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898306E449F28F6</RequestId><HostId></HostId></Error>"
Duration: 39.816987ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
12.171064ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=189830694A4EA12F
X-Request-Id=G28xWbt78RD
X-Xss-Protection=1; mode=block
Content-Length=274
Server=Storj
Date=Fri, 27 Feb 2026 19:14:42 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/1922dc26158aa305
FAIL (2026-02-27 19:14:42 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830694A4EA12F</RequestId><HostId></HostId></Error>"
Duration: 12.183496ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.807012ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Vary=Origin
X-Amz-Request-Id=18983067F42DAF57
X-Request-Id=fK4mPNSUE1R
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:14:36 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/1a20e18088a6ad6e
FAIL (2026-02-27 19:14:36 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983067F42DAF57</RequestId><HostId></HostId></Error>"
Duration: 8.836762ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
33.385057ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Request-Id=hg5L8uHw5bT
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:14:35 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18983067C848DED5
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/7d71d8496d35824
FAIL (2026-02-27 19:14:35 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983067C848DED5</RequestId><HostId></HostId></Error>"
Duration: 33.402244ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
12.092109ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Server=Storj
Date=Fri, 27 Feb 2026 19:14:21 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=1898306482F1143E
X-Request-Id=bQajXsCV8wL
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/71864789f28f331c
FAIL (2026-02-27 19:14:21 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898306482F1143E</RequestId><HostId></HostId></Error>"
Duration: 12.121148ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.983371ms
remote:
"tcp:136.0.77.3:443"
response headers:
Date=Fri, 27 Feb 2026 19:14:13 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18983062AE09CF92
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Server=Storj
Vary=Origin
X-Request-Id=PFsw6ZrRuFC
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6d8b54c10e9f0edb
FAIL (2026-02-27 19:14:13 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983062AE09CF92</RequestId><HostId></HostId></Error>"
Duration: 9.009143ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
2.105140569s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:14:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.105171192s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
12.555255ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Vary=Origin
X-Amz-Request-Id=189830607F1ACA96
X-Request-Id=E6z1prdaSr7
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Date=Fri, 27 Feb 2026 19:14:04 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/4bb1d95ce6d72898
FAIL (2026-02-27 19:14:04 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830607F1ACA96</RequestId><HostId></HostId></Error>"
Duration: 12.581068ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
27.856652ms
remote:
"tcp:45.38.24.2:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=1898305FBCACF456
X-Request-Id=FD6HKiHkqGN
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:14:01 GMT
Server=Storj
Vary=Origin
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/47cbbd910af659d9
FAIL (2026-02-27 19:14:01 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898305FBCACF456</RequestId><HostId></HostId></Error>"
Duration: 27.937653ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.863517ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898305F1FE7578F
X-Request-Id=SaDPahX1Xbw
Date=Fri, 27 Feb 2026 19:13:58 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/569e678f73198edd
FAIL (2026-02-27 19:13:58 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898305F1FE7578F</RequestId><HostId></HostId></Error>"
Duration: 10.900903ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
2.079426043s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:13:42 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.079455083s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.360156ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=b5hWVbsUU5a
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=189830563FF8EB57
Date=Fri, 27 Feb 2026 19:13:20 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/17685371520f4380
FAIL (2026-02-27 19:13:20 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830563FF8EB57</RequestId><HostId></HostId></Error>"
Duration: 11.388882ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
2.092698392s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:13:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.092726549s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.9862ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Request-Id=KCQkSbue5V2
X-Xss-Protection=1; mode=block
Content-Type=application/xml
X-Amz-Request-Id=18983051B0131ADC
Date=Fri, 27 Feb 2026 19:13:00 GMT
Accept-Ranges=bytes
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/c59da96e76788b2
FAIL (2026-02-27 19:13:00 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983051B0131ADC</RequestId><HostId></HostId></Error>"
Duration: 11.011102ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.390517ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Type=application/xml
Vary=Origin
Date=Fri, 27 Feb 2026 19:12:59 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=189830514F1CE52C
X-Request-Id=EDZU39rnn1E
X-Xss-Protection=1; mode=block
Content-Length=284
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/4332caa7201a338c
FAIL (2026-02-27 19:12:59 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830514F1CE52C</RequestId><HostId></HostId></Error>"
Duration: 30.418014ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.632187ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=cAh5LC1YZvf
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:12:44 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=1898304DD39B0011
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/14e22b2365252e9c
FAIL (2026-02-27 19:12:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304DD39B0011</RequestId><HostId></HostId></Error>"
Duration: 11.724799ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.876899ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898304DE7B4F863
X-Request-Id=FzPWzfiTr3n
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:12:44 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/73882ca6fad5f753
FAIL (2026-02-27 19:12:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304DE7B4F863</RequestId><HostId></HostId></Error>"
Duration: 9.90582ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.501526ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=1898304D5ABE713A
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=7BhSCTXddCz
Date=Fri, 27 Feb 2026 19:12:42 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/616b7e13ae134e85
FAIL (2026-02-27 19:12:42 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304D5ABE713A</RequestId><HostId></HostId></Error>"
Duration: 10.525635ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
2.077033169s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:12:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.077084024s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.018495ms
remote:
"tcp:45.38.24.2:443"
response headers:
Accept-Ranges=bytes
X-Request-Id=NLjhZhszjpV
Date=Fri, 27 Feb 2026 19:12:33 GMT
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898304B520EEAF9
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/6fcaca60273e800d
FAIL (2026-02-27 19:12:33 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898304B520EEAF9</RequestId><HostId></HostId></Error>"
Duration: 30.045704ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.762315ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Vary=Origin
Date=Fri, 27 Feb 2026 19:12:25 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=189830496644F43F
X-Request-Id=NcACVVyiKrx
X-Xss-Protection=1; mode=block
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/60ffe3b3f0d4a183
FAIL (2026-02-27 19:12:25 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830496644F43F</RequestId><HostId></HostId></Error>"
Duration: 11.786112ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.21585ms
remote:
"tcp:136.0.77.3:443"
response headers:
Date=Fri, 27 Feb 2026 19:12:17 GMT
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=QGJGtvmpfuo
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18983047A5C82C7F
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/54574e481bcf8157
FAIL (2026-02-27 19:12:17 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983047A5C82C7F</RequestId><HostId></HostId></Error>"
Duration: 11.243318ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
13.068179ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Vary=Origin
X-Amz-Request-Id=18983043F4A71D30
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:12:01 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=eCgbHBzqnoc
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/7b3da4579add983b
FAIL (2026-02-27 19:12:01 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983043F4A71D30</RequestId><HostId></HostId></Error>"
Duration: 13.098761ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
2.05725854s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:11:39 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057290582s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.165678ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=1898303E485EB7A8
X-Xss-Protection=1; mode=block
Content-Length=274
Server=Storj
X-Request-Id=YUnzKCaoQzE
Date=Fri, 27 Feb 2026 19:11:37 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/417c9dd5f966290a
FAIL (2026-02-27 19:11:37 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303E485EB7A8</RequestId><HostId></HostId></Error>"
Duration: 11.196864ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.725197ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Vary=Origin
X-Request-Id=Hfzd3GfLZ1k
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:11:31 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=1898303CE88A4A94
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/1dfbf23590eade61
FAIL (2026-02-27 19:11:31 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303CE88A4A94</RequestId><HostId></HostId></Error>"
Duration: 9.751219ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
27.4294ms
remote:
"tcp:45.38.24.2:443"
response headers:
Server=Storj
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:11:25 GMT
Accept-Ranges=bytes
Vary=Origin
X-Amz-Request-Id=1898303B9556F318
X-Request-Id=6d2cQ5eQAZd
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/142e5f904e548384
FAIL (2026-02-27 19:11:25 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303B9556F318</RequestId><HostId></HostId></Error>"
Duration: 27.475507ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.40877ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898303B80B2E2BA
X-Request-Id=iv9ecSPoYsa
Date=Fri, 27 Feb 2026 19:11:25 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/1f4c5f0f1c6eeb47
FAIL (2026-02-27 19:11:25 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303B80B2E2BA</RequestId><HostId></HostId></Error>"
Duration: 10.431745ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
2.172597628s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:11:04 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.172632509s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.930086ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Date=Fri, 27 Feb 2026 19:11:03 GMT
Accept-Ranges=bytes
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898303670DAC9AC
X-Request-Id=Jc6gmLmg5AB
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/14398a5114ffdb77
FAIL (2026-02-27 19:11:03 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898303670DAC9AC</RequestId><HostId></HostId></Error>"
Duration: 11.953915ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.271697ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Vary=Origin
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=189830330DA61115
X-Request-Id=KGr1PVNEks8
Date=Fri, 27 Feb 2026 19:10:49 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/316b809bf64e4202
FAIL (2026-02-27 19:10:49 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830330DA61115</RequestId><HostId></HostId></Error>"
Duration: 10.314254ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.428897ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Type=application/xml
X-Amz-Request-Id=18983032F491B5FA
X-Request-Id=8VJdiQNAU2A
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Date=Fri, 27 Feb 2026 19:10:48 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3cc7109cd4c156c1
FAIL (2026-02-27 19:10:48 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983032F491B5FA</RequestId><HostId></HostId></Error>"
Duration: 30.451829ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
2.114821727s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:10:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.114854395s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.574747ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=1898302BCF445FE2
X-Request-Id=PjbbuASeY8y
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:10:18 GMT
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/48a8ec629a911d69
FAIL (2026-02-27 19:10:18 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898302BCF445FE2</RequestId><HostId></HostId></Error>"
Duration: 10.597609ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.418745ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=189830291BDDAEF9
X-Request-Id=4Db9RZQB8ox
Date=Fri, 27 Feb 2026 19:10:06 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/3e1e4c538a296697
FAIL (2026-02-27 19:10:06 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830291BDDAEF9</RequestId><HostId></HostId></Error>"
Duration: 11.482253ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.061074ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18983027CA81F610
X-Request-Id=SLL3m7FB2Ru
Date=Fri, 27 Feb 2026 19:10:00 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/336af2bf7178584b
FAIL (2026-02-27 19:10:00 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983027CA81F610</RequestId><HostId></HostId></Error>"
Duration: 11.102171ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
12.364302ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=189830265B8BF917
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:09:54 GMT
Accept-Ranges=bytes
Content-Length=274
X-Request-Id=AnCxiWHhXM7
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/3f6eb92d15ad737d
FAIL (2026-02-27 19:09:54 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189830265B8BF917</RequestId><HostId></HostId></Error>"
Duration: 12.392514ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.390649ms
remote:
"tcp:45.38.24.2:443"
response headers:
X-Amz-Request-Id=18983024DBD4A3A8
X-Request-Id=SqYMVufPNqR
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Date=Fri, 27 Feb 2026 19:09:48 GMT
Accept-Ranges=bytes
Content-Length=284
Content-Type=application/xml
Server=Storj
Vary=Origin
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/13d062eae4dddc62
FAIL (2026-02-27 19:09:48 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983024DBD4A3A8</RequestId><HostId></HostId></Error>"
Duration: 30.42993ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
2.057800459s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:09:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057864476s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.784845ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=L2Er9Z74PRm
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 19:09:38 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18983022AA2E9922
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/7a6b558b3a999a12
FAIL (2026-02-27 19:09:38 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983022AA2E9922</RequestId><HostId></HostId></Error>"
Duration: 10.809228ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.093223ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18983021178AB868
X-Request-Id=9pNP8b5qyaE
Date=Fri, 27 Feb 2026 19:09:32 GMT
Content-Length=274
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/e91227e43ea56b8
FAIL (2026-02-27 19:09:32 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983021178AB868</RequestId><HostId></HostId></Error>"
Duration: 9.113611ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.304063ms
remote:
"tcp:136.0.77.3:443"
response headers:
Date=Fri, 27 Feb 2026 19:09:26 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Request-Id=EctJH6cEGA9
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=1898301FE1CE0418
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/46ebf0b449f90ff6
FAIL (2026-02-27 19:09:26 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898301FE1CE0418</RequestId><HostId></HostId></Error>"
Duration: 10.334575ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
2.057952028s
trace:
https://jaeger.dev.storj.io/trace/5ba7b9ab33770c8
FAIL (2026-02-27 19:09:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ess=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.881920320 (238h47m29.685279497s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882277613 (238h47m29.685636797s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882304171 (238h47m29.685663353s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.882721732 (238h47m29.68608091s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883170726 (238h47m29.686529903s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.883675356 (238h47m29.687034539s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884309144 (238h47m29.687668328s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.884827042 (238h47m29.68818621s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.887870537 (238h47m29.691229718s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.888962425 (238h47m29.692321668s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:28.889823462 (238h47m29.693182639s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Uploading piece...
Feb 27 19:03:29.305942479 (238h47m30.109301644s) [upload=248562]: Next returned nil segment
Feb 27 19:03:29.305967164 (238h47m30.109326339s) [upload=248562]: Waiting for error group managing segments...
Feb 27 19:03:29.485292528 (238h47m30.288651714s) [noise=true , address=81.171.14.70:4032    , piece_id=GVGNNAVZFDEQPI6BT6ZRDOWEDEJGTI5CRWZQDQ7ROPCYV4WU2OMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488867142 (238h47m30.292226317s) [noise=true , address=81.171.14.70:4042    , piece_id=JK6BODBCGQGSFSFPS4DADNUW4SLFV2ERJPWT6IZVVGD5JNBQXKQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.488939564 (238h47m30.292298726s) [noise=true , address=81.171.14.70:4038    , piece_id=KKVAZ7XUADG7JYHVSIXKTHJDXKCUICAGRZSBZHCSPD36LW6OYT2Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.493270337 (238h47m30.29662951s) [noise=true , address=81.171.14.70:4025    , piece_id=JAKRF6PR6HKFBA536E3EQQ3WCWKDTYUXXCWG4THF5AFMACWK5H5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.494182345 (238h47m30.297541509s) [noise=true , address=81.171.14.70:4030    , piece_id=RXX3L2JLRR63LJMPPHD4KIB4S3ETKXPJGZ7SO7YIVEPNX7J4SOUA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.495569378 (238h47m30.298928546s) [noise=true , address=81.171.14.70:4034    , piece_id=TKUZL52SXKKF4KUVCSTYIMJTTBZZ5NZ7WYQSLH4Z4DMYQD2GLWNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.497221478 (238h47m30.300580654s) [noise=true , address=185.167.204.205:4016 , piece_id=TKSQKNTBVIDDBR3UPJLX7ZCNMFMEXYPXL7YJCQ4ZSPYG2H76PY3A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.498481050 (238h47m30.301840223s) [noise=true , address=81.171.14.70:4047    , piece_id=XSDESMXZSX2FPVCIM6X533ZVBQ2NRCKCUSJ7UBEOCG76RCVOFFQA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.499128725 (238h47m30.302487899s) [noise=true , address=81.171.14.70:4033    , piece_id=UTG5PYLTCAKPYWHBFIEHYPQGWX7V2CWPPZUS3IHHM6IWHG2RSYIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.500770132 (238h47m30.304129311s) [noise=true , address=185.167.204.205:4011 , piece_id=BGJAKT35K6HYKSBM75R7Y527P2WEJHTWDZNVVYZOKLZOD3GWQDTA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520282724 (238h47m30.323641898s) [noise=true , address=89.149.201.147:4024  , piece_id=SPWYXRSYXBFJVRYRX7KUN2PPIKMOJAM5PEJJMDTU7MCO52BBOGIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.520458144 (238h47m30.323817325s) [noise=true , address=89.149.201.147:4017  , piece_id=EQXPHI4WOCMNHULZT3KP4RXHHCUVM77FGPPLOQOSBODSKAE4NVRQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.528608534 (238h47m30.331967713s) [noise=true , address=185.167.204.206:4040 , piece_id=NBIGXDP7K2G2DYUTEHCSML4X5QF6DWITXNOX6G6LJCWOLUZZJWHA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.530517514 (238h47m30.333876679s) [noise=true , address=81.171.14.70:4029    , piece_id=P4PKJ6ZBWW5XJQ3ABVC5KDGVROK6TWZFEYOLJIMVO4GH4P27NY5Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.540229723 (238h47m30.343588896s) [noise=true , address=185.167.204.206:4039 , piece_id=B4BO7RY4U3QHZKNAAGUKFVLO3F7SCHPYM4TNUXBYM3UWIFC6RSIQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.549193658 (238h47m30.352552843s) [noise=true , address=185.167.204.206:4037 , piece_id=4QRWKI66B2SVG2OWNQ5MQMQO33ZLWEV6OABDFMQWDNJVHWMRTJFQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.573203429 (238h47m30.376562603s) [noise=true , address=185.167.204.205:4007 , piece_id=JSFJFE6J7T3OYZUCU6OSGBTOGTDKXWKUX2GKZBZJPC4XMVUHI2RA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578612555 (238h47m30.381971729s) [noise=true , address=185.167.204.206:4072 , piece_id=NWCN7VZ7C77J32GXW7MUFMACI3V45J7YQPRWIVNICO5E6N6Q5DBA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.578869362 (238h47m30.382228531s) [noise=true , address=185.167.204.206:4041 , piece_id=PNMLNBEI5MCZSXIELZF22U7C5FBTJ3NKZVSMHHBZ4NHRO4CE2JMQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585453146 (238h47m30.388812327s) [noise=true , address=89.149.201.147:4004  , piece_id=R6KLLIMXVNYBDWH2W5KCOBWCQYF7RO47TFQKPHOR3UTYY446ATQQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.585510255 (238h47m30.388869432s) [noise=true , address=185.167.204.205:4009 , piece_id=UW66SRSI27LFSDXBPXZVA4SOIXQSEDIQAGCCPNFOIDYC6CO5DNXA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.607509471 (238h47m30.41086865s) [noise=true , address=185.167.204.206:4053 , piece_id=7CEFYGFPOKLIDAZWBEPBJ43O4OVYYUF66WABXWM7RADT4OBQ4AWQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.622982646 (238h47m30.426341819s) [noise=true , address=185.167.204.206:4046 , piece_id=6ZTW47UKRKWVYGJHOBHANVWZWE6PDHRLITMD5VUNCARVASHK47AQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:29.635158349 (238h47m30.438517522s) [noise=true , address=185.167.204.205:4020 , piece_id=BRCPVT4JBAXGNYY7N547DSMTC7L2IKGG7RHT7MU7ISL2NC3ZDBCQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:03:35.525495067 (238h47m36.328854242s) [noise=true , address=185.167.204.206:4044 , piece_id=2XMMX3NSARIQBL6SHBUTLTCTN7VC5HNHW5B5VGX4SBKNJTUDBSNA, seg_pos={0 0}, upload=248562]: Done uploading piece. err: <nil>
Feb 27 19:04:28.508369911 (238h48m29.311729091s) [noise=true , address=89.149.201.147:4010  , piece_id=RY3V22SFDMDJL2SA67IVSIA3HL5ZXWFPDFEGKVTN3OJ6A3EY257Q, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:56278->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508664395 (238h48m29.312023562s) [noise=true , address=89.149.201.147:4001  , piece_id=ORKT2SIHXBZWT626NROJIJGONLRAI3YOFHAFDQ7JOOEQMHNDPAPQ, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:49320->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 19:04:28.508923513 (238h48m29.312282696s) [noise=true , address=89.149.201.147:4023  , piece_id=NWUSBCFDTVH67AO5RFAUMRBP7I4BA6LM2SS46REMDANS5PULE33A, seg_pos={0 0}, upload=248562]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:48854->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: context deadline exceeded
Feb 27 19:04:28.508961365 (238h48m29.312320533s) [seg_pos={0 0}, upload=248562]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 19:04:28.611109748 (238h48m29.414468923s) [upload=248562]: Done uploading segments...
Feb 27 19:04:28.611159571 (238h48m29.414518748s) [upload=248562]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057992296s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
15.109764ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=1898301788FD547B
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=hhkXJnddTJ7
Date=Fri, 27 Feb 2026 19:08:51 GMT
Accept-Ranges=bytes
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/4a9eb249d4573622
FAIL (2026-02-27 19:08:51 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898301788FD547B</RequestId><HostId></HostId></Error>"
Duration: 15.197603ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
28.228777ms
remote:
"tcp:45.38.24.2:443"
response headers:
Date=Fri, 27 Feb 2026 19:08:47 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18983016AD17BE05
X-Request-Id=8h99dWWpT4q
Content-Length=284
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/47923e3700106f54
FAIL (2026-02-27 19:08:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18983016AD17BE05</RequestId><HostId></HostId></Error>"
Duration: 28.261677ms edge gateway vhost us-select-1