Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 335026 reports (Page 1887 of 6701)
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
29.406599ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898177A624B7BD3
X-Request-Id=LZuMa1vFoDk
Date=Fri, 27 Feb 2026 11:37:47 GMT
Accept-Ranges=bytes
Content-Type=application/xml
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/64f010e09472109a
FAIL (2026-02-27 11:37:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898177A624B7BD3</RequestId><HostId></HostId></Error>"
Duration: 29.437052ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
377.872864ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:37:45 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 377.902034ms core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...]
duration:
121.854827ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/62a88d33b2c4b662
FAIL (2026-02-27 11:37:25 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 121.881161ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.972168ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
Content-Type=application/xml
X-Amz-Request-Id=18981774989CB0DE
X-Request-Id=iuEafsMu41Q
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:37:22 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/777670e98ec8bf55
FAIL (2026-02-27 11:37:22 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981774989CB0DE</RequestId><HostId></HostId></Error>"
Duration: 10.997702ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
13.60586ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Server=Storj
X-Amz-Request-Id=189817739F480EA5
Date=Fri, 27 Feb 2026 11:37:18 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Request-Id=f2mQjFANC9R
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/4f77ee29eff29ff9
FAIL (2026-02-27 11:37:18 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817739F480EA5</RequestId><HostId></HostId></Error>"
Duration: 13.634579ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
1.390191233s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:37:09 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.390217115s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
558.98953ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:37:01 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 559.010091ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
28.933414ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=L8aUwZS4HTi
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:37:01 GMT
Accept-Ranges=bytes
Content-Length=284
X-Amz-Request-Id=1898176F7EC78E9E
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/58b4945901f2f7d3
FAIL (2026-02-27 11:37:01 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898176F7EC78E9E</RequestId><HostId></HostId></Error>"
Duration: 28.959797ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..]
duration:
115.2296ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/62a88d33b2c4b662
FAIL (2026-02-27 11:36:59 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 115.280817ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.707061ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Server=Storj
X-Amz-Request-Id=1898176F239A01C3
X-Request-Id=9jdbpPZTvUN
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:36:59 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/788858cc021ecbb5
FAIL (2026-02-27 11:36:59 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898176F239A01C3</RequestId><HostId></HostId></Error>"
Duration: 10.776822ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
9.063538ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18981767A0F7D5E5
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Request-Id=Pd2tk5uhYKs
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:36:27 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/56dafe5b77923e64
FAIL (2026-02-27 11:36:27 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981767A0F7D5E5</RequestId><HostId></HostId></Error>"
Duration: 9.091761ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
14.234248ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
X-Request-Id=8W8Tg6NPStQ
Date=Fri, 27 Feb 2026 11:36:22 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18981766A290DD3F
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/7480525847d8a86c
FAIL (2026-02-27 11:36:22 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981766A290DD3F</RequestId><HostId></HostId></Error>"
Duration: 14.25855ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
549.079254ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:36:18 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 549.106213ms core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.]
duration:
110.696373ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/62a88d33b2c4b662
FAIL (2026-02-27 11:36:14 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 110.716917ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
1.237182667s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:36:05 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.237207275s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.546845ms
remote:
"tcp:136.0.77.3:443"
response headers:
Date=Fri, 27 Feb 2026 11:36:05 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18981762A14F8479
X-Request-Id=hwQtey9vp8F
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/49d749a9509671b5
FAIL (2026-02-27 11:36:05 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981762A14F8479</RequestId><HostId></HostId></Error>"
Duration: 11.637538ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
35.49291ms
remote:
"tcp:45.38.24.2:443"
response headers:
X-Amz-Request-Id=189817622C43C29B
X-Request-Id=eD7vs2cjnar
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Date=Fri, 27 Feb 2026 11:36:03 GMT
Accept-Ranges=bytes
Content-Length=284
Content-Type=application/xml
Server=Storj
Vary=Origin
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/740c0031510b5165
FAIL (2026-02-27 11:36:03 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817622C43C29B</RequestId><HostId></HostId></Error>"
Duration: 35.511908ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.244295ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898175FECFB9241
Date=Fri, 27 Feb 2026 11:35:54 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Request-Id=3RGHQD1ejGY
X-Xss-Protection=1; mode=block
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/347cb5b6edb5009b
FAIL (2026-02-27 11:35:54 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898175FECFB9241</RequestId><HostId></HostId></Error>"
Duration: 11.367776ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
1.156620775s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:35:47 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.156717681s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
448.992791ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:35:35 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 449.024932ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.743253ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:35:27 GMT
Accept-Ranges=bytes
Content-Length=274
Server=Storj
X-Request-Id=T2JdY2xFsEa
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18981759D1E95EDE
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/3658beae053267f7
FAIL (2026-02-27 11:35:27 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981759D1E95EDE</RequestId><HostId></HostId></Error>"
Duration: 10.770686ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
14.896486ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=189817594C53F319
X-Request-Id=iEBzE4y9zB9
Date=Fri, 27 Feb 2026 11:35:25 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/452b68ac6d559cfb
FAIL (2026-02-27 11:35:25 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817594C53F319</RequestId><HostId></HostId></Error>"
Duration: 14.924664ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.871812ms
remote:
"tcp:45.38.24.2:443"
response headers:
Vary=Origin
Date=Fri, 27 Feb 2026 11:35:22 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=1898175889F6E8F5
X-Request-Id=iLQacNVjeAn
X-Xss-Protection=1; mode=block
Content-Length=284
Server=Storj
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/52675d88000d6e19
FAIL (2026-02-27 11:35:22 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898175889F6E8F5</RequestId><HostId></HostId></Error>"
Duration: 30.899967ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
1.434620162s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:35:20 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.434653203s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.137477ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=1898175479F50082
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:35:04 GMT
Accept-Ranges=bytes
Content-Length=274
Server=Storj
Vary=Origin
X-Request-Id=ex5HmjTqpPh
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/4341579577ace30d
FAIL (2026-02-27 11:35:04 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898175479F50082</RequestId><HostId></HostId></Error>"
Duration: 10.163791ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
14.411372ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18981754166451C3
Content-Length=274
X-Request-Id=ZjtnfhvmMNH
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:35:03 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/7d32daee53270032
FAIL (2026-02-27 11:35:03 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981754166451C3</RequestId><HostId></HostId></Error>"
Duration: 14.452709ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
1.735246172s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:35:02 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.735310767s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.855356ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18981751849A99C6
Accept-Ranges=bytes
Content-Length=284
Server=Storj
Vary=Origin
X-Request-Id=6a2Cc5sxHZx
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:34:52 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/1fedc15db44244e0
FAIL (2026-02-27 11:34:52 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981751849A99C6</RequestId><HostId></HostId></Error>"
Duration: 30.877498ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
12.098618ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=189817516C7CF075
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:34:51 GMT
Server=Storj
X-Request-Id=b4YoFEP2JuP
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/4814fda25b61bbb5
FAIL (2026-02-27 11:34:51 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817516C7CF075</RequestId><HostId></HostId></Error>"
Duration: 12.122311ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
28.573796ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Type=application/xml
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898174C0A5BAC87
X-Request-Id=Nv75bq51CYF
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:34:28 GMT
Content-Length=284
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/31cbeaf9e8d6ed28
FAIL (2026-02-27 11:34:28 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898174C0A5BAC87</RequestId><HostId></HostId></Error>"
Duration: 28.667965ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
15.553458ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898174AC48823BC
X-Request-Id=MJCzrmk94XA
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:34:23 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/7358349e3a3aa64d
FAIL (2026-02-27 11:34:23 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898174AC48823BC</RequestId><HostId></HostId></Error>"
Duration: 15.577805ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
568.339055ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:34:21 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 568.368622ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
1.534233527s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:34:17 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.53426057s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.118662ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=gvRKyZpoMvc
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:34:08 GMT
Accept-Ranges=bytes
Vary=Origin
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=1898174750440035
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/25b5b73dc608945
FAIL (2026-02-27 11:34:08 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898174750440035</RequestId><HostId></HostId></Error>"
Duration: 10.132983ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.449413ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=189817454234F6B0
Date=Fri, 27 Feb 2026 11:33:59 GMT
Accept-Ranges=bytes
Content-Type=application/xml
X-Request-Id=a9a5YY5FmG5
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/725ca23d543b49d2
FAIL (2026-02-27 11:33:59 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817454234F6B0</RequestId><HostId></HostId></Error>"
Duration: 11.478989ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
32.089639ms
remote:
"tcp:45.38.24.2:443"
response headers:
Date=Fri, 27 Feb 2026 11:33:44 GMT
Content-Length=284
Content-Type=application/xml
X-Request-Id=L3ZKs8ZinTA
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18981741C43BE859
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/5a2b6767fbb2686b
FAIL (2026-02-27 11:33:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981741C43BE859</RequestId><HostId></HostId></Error>"
Duration: 32.114763ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
1.81068228s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:33:42 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.810715859s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.198827ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Content-Type=application/xml
X-Amz-Request-Id=18981740A4D4088D
X-Request-Id=efoS12WKq5P
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:33:39 GMT
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/61b156b6698caeea
FAIL (2026-02-27 11:33:39 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981740A4D4088D</RequestId><HostId></HostId></Error>"
Duration: 11.230473ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
359.530885ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:33:36 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 359.56151ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
13.517296ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898173DFB607D44
X-Request-Id=8ZSsrhMsZeU
Date=Fri, 27 Feb 2026 11:33:28 GMT
Content-Security-Policy=block-all-mixed-content
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/699934285341a4db
FAIL (2026-02-27 11:33:28 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898173DFB607D44</RequestId><HostId></HostId></Error>"
Duration: 13.552141ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
13.192089ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=1898173B0B698F8A
X-Request-Id=FQXq7Wd6ngY
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:33:15 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/573a992f595efa0f
FAIL (2026-02-27 11:33:15 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898173B0B698F8A</RequestId><HostId></HostId></Error>"
Duration: 13.294561ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.402372ms
remote:
"tcp:45.38.24.2:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=1898173AC90E7AF8
X-Request-Id=9j7PgmWTyfc
Date=Fri, 27 Feb 2026 11:33:14 GMT
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3efd3f2432556d2b
FAIL (2026-02-27 11:33:14 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898173AC90E7AF8</RequestId><HostId></HostId></Error>"
Duration: 30.428966ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
576.440509ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:32:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 576.45758ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
1.016363898s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:32:45 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.016389042s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.771257ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Vary=Origin
X-Request-Id=QLiqrT4CEM4
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:32:38 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=189817325B4F97FB
Accept-Ranges=bytes
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/2f8d8979cb1b89a7
FAIL (2026-02-27 11:32:38 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817325B4F97FB</RequestId><HostId></HostId></Error>"
Duration: 11.800046ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
565.232194ms
trace:
https://jaeger.dev.storj.io/trace/31937fbed8d51054
FAIL (2026-02-27 11:32:33 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece...
Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment
Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments...
Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817   , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892   , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555     , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil>
Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908   , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113    , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586   , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163   , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149    , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334    , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570   , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269   , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838   , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441   , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088   , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765   , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835   , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded
Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments...
Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 565.275813ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
15.617139ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=18981730D00F9BB6
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:32:31 GMT
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=QiZ21TuepbL
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/46aaf382a0a3b799
FAIL (2026-02-27 11:32:31 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981730D00F9BB6</RequestId><HostId></HostId></Error>"
Duration: 15.643771ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
31.045054ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Request-Id=WBepPWbsybN
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=284
Server=Storj
Vary=Origin
X-Amz-Request-Id=189817309554F95C
Date=Fri, 27 Feb 2026 11:32:30 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/4e144881d4b5521b
FAIL (2026-02-27 11:32:30 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817309554F95C</RequestId><HostId></HostId></Error>"
Duration: 31.137857ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
1.272892586s
trace:
https://jaeger.dev.storj.io/trace/7628d607698d8ed0
FAIL (2026-02-27 11:32:19 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece...
Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment
Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments...
Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999     , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616     , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868     , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140    , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528     , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587     , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185  , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168  , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224  , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801    , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710    , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777    , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637    , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984   , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil>
Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces
Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF
Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165   , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled
Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014  , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037  , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102  , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold
Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments...
Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil>
Duration: 1.272925998s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.533592ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=1898172A836DFF82
X-Request-Id=83Yro9ZTPFe
X-Xss-Protection=1; mode=block
Date=Fri, 27 Feb 2026 11:32:04 GMT
Accept-Ranges=bytes
Content-Length=274
Server=Storj
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/67e7633ac954ef5b
FAIL (2026-02-27 11:32:04 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898172A836DFF82</RequestId><HostId></HostId></Error>"
Duration: 11.636229ms edge gateway vhost bgp us1