Orbiter History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 12.282121ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898172A5C71084E X-Request-Id=i1yMSAVHPho Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:32:04 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/6f50b839fd6689dd FAIL (2026-02-27 11:32:04 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898172A5C71084E</RequestId><HostId></HostId></Error>" Duration: 12.414242ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 551.844937ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:31:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 551.871653ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 28.739849ms remote: "tcp:45.38.24.2:443" response headers: Vary=Origin X-Request-Id=KTyrHUASSea Date=Fri, 27 Feb 2026 11:31:42 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981725452E4F60 X-Xss-Protection=1; mode=block target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/747a2d348e75667b FAIL (2026-02-27 11:31:42 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981725452E4F60</RequestId><HostId></HostId></Error>" Duration: 28.770018ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 12.600504ms remote: "tcp:136.0.77.3:443" response headers: X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=QD975f2CLSF Date=Fri, 27 Feb 2026 11:31:41 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189817251502D68A target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/690e221a44ba513d FAIL (2026-02-27 11:31:41 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817251502D68A</RequestId><HostId></HostId></Error>" Duration: 12.631845ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.157126ms remote: "tcp:136.0.77.3:443" response headers: Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=189aFLa2yf8 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=1898172309E79D5E Date=Fri, 27 Feb 2026 11:31:32 GMT Content-Length=274 target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/253e9102bb61d8bb FAIL (2026-02-27 11:31:32 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898172309E79D5E</RequestId><HostId></HostId></Error>" Duration: 11.180734ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.303007931s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:31:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.303127348s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 597.512823ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:31:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 597.551083ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.65186ms remote: "tcp:136.0.77.3:443" response headers: X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898171DA6EC328B X-Request-Id=V4k7WxNbiGD Date=Fri, 27 Feb 2026 11:31:09 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/33742f55246e5f3f FAIL (2026-02-27 11:31:09 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898171DA6EC328B</RequestId><HostId></HostId></Error>" Duration: 11.68255ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 29.87659ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898171D0A36D985 X-Request-Id=VjMetXgMWPS X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 11:31:06 GMT target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/5aa0cdaded63cd23 FAIL (2026-02-27 11:31:06 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898171D0A36D985</RequestId><HostId></HostId></Error>" Duration: 29.904584ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 14.263226ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:30:48 GMT Server=Storj Vary=Origin X-Amz-Request-Id=18981718D03608C6 X-Request-Id=GqGRQPkhRwB target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/467a0c45dc3dbcf3 FAIL (2026-02-27 11:30:48 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981718D03608C6</RequestId><HostId></HostId></Error>" Duration: 14.283581ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.316294814s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:30:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.316360122s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 696.083723ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:30:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 696.115757ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.956739ms remote: "tcp:136.0.77.3:443" response headers: Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=18981713D6E0D104 X-Request-Id=ZcC2udCMRZv Date=Fri, 27 Feb 2026 11:30:27 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/476090bff1aab4e FAIL (2026-02-27 11:30:27 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981713D6E0D104</RequestId><HostId></HostId></Error>" Duration: 10.981344ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 12.080731ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898171363A90CD2 Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=MwMt4bbhj4B X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:30:25 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/786de6babe1e3b1a FAIL (2026-02-27 11:30:25 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898171363A90CD2</RequestId><HostId></HostId></Error>" Duration: 12.097763ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 133.775638ms remote: "tcp:45.38.24.2:443" response headers: Server=Storj X-Amz-Request-Id=1898170EEEB6FE84 Accept-Ranges=bytes Vary=Origin X-Request-Id=8Yqaemsq1AL X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:30:06 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/3396a40c8045baa1 FAIL (2026-02-27 11:30:06 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898170EEEB6FE84</RequestId><HostId></HostId></Error>" Duration: 133.806065ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.807378536s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:30:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.807648334s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 15.272188ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898170B4DC59AA8 X-Request-Id=VgVTtcnim8k Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:29:50 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/1e3c101a1d644987 FAIL (2026-02-27 11:29:50 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898170B4DC59AA8</RequestId><HostId></HostId></Error>" Duration: 15.651889ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 578.285423ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:29:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 578.328988ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.318243ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981706CD324B65 X-Request-Id=YsAdG9LfrHx X-Xss-Protection=1; mode=block Content-Length=274 Date=Fri, 27 Feb 2026 11:29:31 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/60b5e3ff769c0c95 FAIL (2026-02-27 11:29:31 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981706CD324B65</RequestId><HostId></HostId></Error>" Duration: 10.418716ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 27.454969ms remote: "tcp:45.38.24.2:443" response headers: Server=Storj Vary=Origin X-Amz-Request-Id=189817053A0D995E X-Request-Id=JXbGLWoKbiM Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:29:24 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/286a79c64d548d3 FAIL (2026-02-27 11:29:24 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817053A0D995E</RequestId><HostId></HostId></Error>" Duration: 27.480098ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.706406ms remote: "tcp:136.0.77.3:443" response headers: Vary=Origin X-Request-Id=LHQWVBoGEFG Date=Fri, 27 Feb 2026 11:29:23 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189817050FC05AE3 X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/1159519accf87dd7 FAIL (2026-02-27 11:29:23 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189817050FC05AE3</RequestId><HostId></HostId></Error>" Duration: 11.74649ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 381.346443ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:29:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 381.371624ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 12.659598ms remote: "tcp:136.0.77.3:443" response headers: Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981700A25FFF74 X-Request-Id=Jvy5X132rvu X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:29:04 GMT Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/41f4076ee9c64513 FAIL (2026-02-27 11:29:04 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981700A25FFF74</RequestId><HostId></HostId></Error>" Duration: 12.681989ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.209423294s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:28:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.209449764s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 51.205751ms remote: "tcp:45.38.24.2:443" response headers: Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=ZRmq3Zqb1oD X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:28:50 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189816FD5C202265 target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/234fb9a29e8e7d18 FAIL (2026-02-27 11:28:50 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816FD5C202265</RequestId><HostId></HostId></Error>" Duration: 51.229253ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 453.775157ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:28:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 453.806411ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 9.451279ms remote: "tcp:136.0.77.3:443" response headers: Date=Fri, 27 Feb 2026 11:28:41 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189816FB498AF30D Vary=Origin X-Request-Id=BYrPTsi7dyy X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/50a922a9104b7a90 FAIL (2026-02-27 11:28:41 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816FB498AF30D</RequestId><HostId></HostId></Error>" Duration: 9.535697ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.39223ms remote: "tcp:136.0.77.3:443" response headers: Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=j8Y4PYBTPKM X-Xss-Protection=1; mode=block X-Amz-Request-Id=189816F9C33955FF Date=Fri, 27 Feb 2026 11:28:35 GMT Accept-Ranges=bytes Content-Length=274 target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/2be42964eaccce7f FAIL (2026-02-27 11:28:35 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816F9C33955FF</RequestId><HostId></HostId></Error>" Duration: 11.414767ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 510.123754ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:28:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 510.155688ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 11.284163ms remote: "tcp:136.0.77.3:443" response headers: X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:28:18 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=189816F5D79E13B5 X-Request-Id=EtHGXPrR8wD target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/24d4ff3700dc8cf5 FAIL (2026-02-27 11:28:18 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816F5D79E13B5</RequestId><HostId></HostId></Error>" Duration: 11.311244ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.328016337s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:28:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.328057423s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 13.81875ms remote: "tcp:136.0.77.3:443" response headers: X-Request-Id=VSht66JyFRq X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 11:27:59 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189816F157765A6D target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/3b8b2ac3b5ed62e7 FAIL (2026-02-27 11:27:59 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816F157765A6D</RequestId><HostId></HostId></Error>" Duration: 13.853606ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 499.346677ms trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:27:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 499.375151ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 28.889886ms remote: "tcp:45.38.24.2:443" response headers: Server=Storj Vary=Origin X-Request-Id=FYdeUPkxzUW Date=Fri, 27 Feb 2026 11:27:38 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=189816EC6E5E74B4 X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/78eb1052e188f64d FAIL (2026-02-27 11:27:38 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816EC6E5E74B4</RequestId><HostId></HostId></Error>" Duration: 28.919077ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.832337ms remote: "tcp:136.0.77.3:443" response headers: Server=Storj Vary=Origin X-Amz-Request-Id=189816EC7E3AFECF X-Request-Id=JSPUwiqJmGR X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:27:38 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Length=274 Content-Type=application/xml target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/7181bb53ad775bcb FAIL (2026-02-27 11:27:38 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816EC7E3AFECF</RequestId><HostId></HostId></Error>" Duration: 10.863713ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.228507029s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:27:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.22853875s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.249908ms remote: "tcp:136.0.77.3:443" response headers: Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=189816EA8ED04DCB Date=Fri, 27 Feb 2026 11:27:30 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Request-Id=YVeg36vj5Cc X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5293bdcf83663b57 FAIL (2026-02-27 11:27:30 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816EA8ED04DCB</RequestId><HostId></HostId></Error>" Duration: 10.313257ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.455911871s trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:27:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 1.455945132s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 9.113459ms remote: "tcp:136.0.77.3:443" response headers: Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189816E5FAEA9876 Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=5ukVAHfG3Wm X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:27:10 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/673c6f18df21a86f FAIL (2026-02-27 11:27:10 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816E5FAEA9876</RequestId><HostId></HostId></Error>" Duration: 9.135819ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 14.498798ms remote: "tcp:136.0.77.3:443" response headers: Content-Type=application/xml X-Request-Id=L2yoznojG6C X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189816E5C6CAF95F Date=Fri, 27 Feb 2026 11:27:09 GMT Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/6ea5c418133342f1 FAIL (2026-02-27 11:27:09 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816E5C6CAF95F</RequestId><HostId></HostId></Error>" Duration: 14.591423ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.429258254s trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:26:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 1.429283682s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.973151006s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:26:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.973174796s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.402889ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189816E1337E7019 X-Request-Id=8FCruRJJEPm Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:26:49 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/33f63ee06212764c FAIL (2026-02-27 11:26:49 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816E1337E7019</RequestId><HostId></HostId></Error>" Duration: 10.430316ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.692085972s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:26:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1.692109892s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003466491s trace: https://jaeger.dev.storj.io/trace/7628d607698d8ed0 FAIL (2026-02-27 11:26:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== YIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519339109 (231h9m36.322698292s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519733811 (231h9m36.323092994s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.519789218 (231h9m36.323148393s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520119306 (231h9m36.323478482s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520321235 (231h9m36.32368041s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520613013 (231h9m36.323972186s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520733848 (231h9m36.324093022s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.520976732 (231h9m36.324335913s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521144257 (231h9m36.324503433s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521331231 (231h9m36.324690408s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521539144 (231h9m36.324898319s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521707640 (231h9m36.325066815s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.521915733 (231h9m36.325274914s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.522556237 (231h9m36.32591543s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523058033 (231h9m36.326417207s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.523469810 (231h9m36.326828987s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Uploading piece... Feb 27 11:25:35.582012492 (231h9m36.385371667s) [upload=240626]: Next returned nil segment Feb 27 11:25:35.582026340 (231h9m36.385385521s) [upload=240626]: Waiting for error group managing segments... Feb 27 11:25:35.585491802 (231h9m36.388850962s) [noise=true , address=45.91.116.6:4999 , piece_id=JJBXUH2YW4H3IJWI6WHWT6TQCFUEIWEDJEREQAMTSICTMEYIWOQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.600399337 (231h9m36.403758511s) [noise=true , address=77.90.31.12:4616 , piece_id=PHWBJH7ZFZ64KVIYKEM54PQNTEXFJY3IIPLXCZDNTSIMMND3UVSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603114469 (231h9m36.406473643s) [noise=true , address=77.90.31.19:4868 , piece_id=IYRC7MELBK5DW7MOYOPSVCNCNVQES3XMYJKNVMHGNRLCCEK7RTTA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.603394111 (231h9m36.406753285s) [noise=true , address=45.91.116.11:4140 , piece_id=WFDBCOIZNCFSP2T7KYUKEUYCY5QW6B7JSQFGL2KXK6RRCZPRULJQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.609287276 (231h9m36.412646454s) [noise=true , address=77.90.31.10:4528 , piece_id=I3HY2DBEGJL5G3NXWKCGNCLDHIUC5ZXP7KXYBRAAM2NCKI7QDDSQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:35.647782873 (231h9m36.451142038s) [noise=true , address=77.90.31.11:4587 , piece_id=4BEHXGF5KS44ZEF6LH56VADVBIBN5PMRITL556B26UK7HRHOQ6PQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.057556673 (231h9m36.860915847s) [noise=true , address=79.127.205.234:4185 , piece_id=BYF7BAMMDYGOSX5I4YN5LJM3XQYHUPXAUHIGXTJRB3O3JBIN7HJA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.068368514 (231h9m36.871727693s) [noise=true , address=79.127.205.233:4168 , piece_id=SAXEDX7D4SM7MFTIS44F6WZP37OHVW46EHUL7HUOWMMQ4XSLZKNA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.092690980 (231h9m36.896050197s) [noise=true , address=79.127.205.237:4224 , piece_id=WDIV4YLHNWAE5NSTP7YRICYW7IZ3KTTLTM2LUBI47HXGXVTOQQBQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:36.960073079 (231h9m37.763432243s) [noise=true , address=167.17.72.71:4801 , piece_id=KE4YFB7LR6DAC4UW3GVJDU2A6S573GQ4TZMEEGHDWDUCEW7RNOFA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.141633862 (231h9m37.944993037s) [noise=true , address=167.17.72.69:4710 , piece_id=FHR56SMA35RNVP6TZ7GAXMKBVF6UC4ZJWQ5PNRM32HURTS4PEIAQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:37.175011177 (231h9m37.978370342s) [noise=true , address=167.17.72.70:4777 , piece_id=24CGZDSJ7FCGYAMVAAFYLCVH6KOJYAIXS5BX3D7FOBUOLHNTUSRA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:25:38.903189288 (231h9m39.706548453s) [noise=true , address=167.17.72.68:4637 , piece_id=63YHKBM45MR2CA5PWVZLWUAXGMEWOSHBC5IKQXO3EVTC5R3E4HGQ, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113102343 (231h10m7.916461525s) [noise=true , address=145.79.227.38:4984 , piece_id=MKESOPIEBFKEQBV7JLVKZIUGMDEVQNDHEQBTN4NPDYWJKMTFZE2A, seg_pos={0 0}, upload=240626]: Done uploading piece. err: <nil> Feb 27 11:26:07.113132075 (231h10m7.916491255s) [seg_pos={0 0}, upload=240626]: Satisfied cohort requirements after 14 pieces Feb 27 11:26:07.113450784 (231h10m7.916810006s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wGUMXVEubEtki4qGnjGEsbYFB1iUauZcu3oDRKrCQsJMV3bV2): protocol: expected piece hash; context canceled; EOF Feb 27 11:26:07.113465678 (231h10m7.916824887s) [noise=true , address=145.79.227.43:4165 , piece_id=PRSTOVT4AWMOFT4VKOHCEAGFCH6O7UPKAXZPYGLSMYIRHIIJIZIA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113679993 (231h10m7.917039176s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127L6mZH1Xv1WRFqiiHE7tyVXTEF6iaf9GpAmnMFZMcXDisCmwz): protocol: context canceled; context canceled Feb 27 11:26:07.113688728 (231h10m7.917047902s) [noise=true , address=193.149.164.67:4014 , piece_id=KCFX6WZ6MPZ4E2CVDZOV7Z6Q2WPDA62MJ4LFAFWAGFC3VMBY36ZA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113813993 (231h10m7.917173176s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14NecSTRUn2Hi1RwFidQbd5Jm3XnraVPz6XTWuo6Y7uy2W6q8J): protocol: read tcp 159.223.143.39:58764->193.149.164.68:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113835866 (231h10m7.917195031s) [noise=true , address=193.149.164.68:4037 , piece_id=UETZTTRAOE37KPQ6TRVH6Y5QJQNJX3PPZ3UUNKOM75FSP7QN6TQA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113942596 (231h10m7.917301779s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12i3PBJEuA51nnHNnYjiR7bMPBotipQaAfNrU1WD1YWHJf74LSz): protocol: rpc: dial tcp 193.149.164.69:4102: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:26:07.113950225 (231h10m7.917309402s) [noise=true , address=193.149.164.69:4102 , piece_id=BB6XYZSMVL7WMHBPBWEEXXMKUBDL4EI7SHOEZNPDA755TXB6MBLA, seg_pos={0 0}, upload=240626]: Long tail cancellation due to optimal threshold Feb 27 11:26:07.113966956 (231h10m7.91732612s) [seg_pos={0 0}, upload=240626]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Feb 27 11:26:07.114064114 (231h10m7.917423278s) [upload=240626]: Flush batch item: pb.BatchRequestItem_SegmentCommit Feb 27 11:26:07.114070640 (231h10m7.917429819s) [upload=240626]: Flush batch item: pb.BatchRequestItem_ObjectCommit Feb 27 11:26:07.150013601 (231h10m7.953372781s) [upload=240626]: Done uploading segments... Feb 27 11:26:07.150039249 (231h10m7.953398423s) [upload=240626]: Upload finished. err: <nil> Duration: 1m0.00349161s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.457596ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=RLbNBPCujSP X-Xss-Protection=1; mode=block X-Amz-Request-Id=189816DC888B994F Date=Fri, 27 Feb 2026 11:26:29 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace: https://jaeger.dev.storj.io/trace/5c3a157442fa991e FAIL (2026-02-27 11:26:29 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816DC888B994F</RequestId><HostId></HostId></Error>" Duration: 30.497289ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.608133ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=Gnir61KKAeN Content-Length=274 Vary=Origin X-Amz-Request-Id=189816DC82D0A6B0 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 11:26:29 GMT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/2657676c4baaa232 FAIL (2026-02-27 11:26:29 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816DC82D0A6B0</RequestId><HostId></HostId></Error>" Duration: 10.635912ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 10.019061ms remote: "tcp:136.0.77.3:443" response headers: Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 X-Amz-Request-Id=189816DB0168CF22 X-Request-Id=8tV2xr2g38V Date=Fri, 27 Feb 2026 11:26:23 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/30ff06a56c0af82 FAIL (2026-02-27 11:26:23 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816DB0168CF22</RequestId><HostId></HostId></Error>" Duration: 10.062266ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 15.780346794s trace: https://jaeger.dev.storj.io/trace/31937fbed8d51054 FAIL (2026-02-27 11:26:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== .219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.255769533 (231h9m9.05912871s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.256709077 (231h9m9.060068266s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257240184 (231h9m9.060599362s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.257725525 (231h9m9.061084711s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258301751 (231h9m9.061660924s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.258749760 (231h9m9.062108937s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.259339960 (231h9m9.062699135s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260568070 (231h9m9.063927257s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.260867617 (231h9m9.064226794s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.262339424 (231h9m9.065698607s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.263087283 (231h9m9.066446457s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.264549137 (231h9m9.067908311s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.267941386 (231h9m9.071300561s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.270344692 (231h9m9.073703866s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.272567524 (231h9m9.075926704s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Uploading piece... Feb 27 11:25:08.339199303 (231h9m9.142558479s) [upload=240619]: Next returned nil segment Feb 27 11:25:08.339218915 (231h9m9.142578096s) [upload=240619]: Waiting for error group managing segments... Feb 27 11:25:08.345359619 (231h9m9.148718828s) [noise=true , address=79.127.219.38:4817 , piece_id=KY2YEDXONRAPMITK5D4FRV7NNO3AKC5BRJTALMSGOH6FAMCNNJPA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.345460251 (231h9m9.14881943s) [noise=true , address=79.127.219.46:4892 , piece_id=45MDWCXIUWOX45ITF3R42JATKWZSKSOTQJZB2ORAB3LNNILL2UVA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:08.363506128 (231h9m9.166865308s) [noise=true , address=77.90.31.11:4555 , piece_id=6OCURWGD7GRP4L3WSWAHVFONFNFD5D75Q432D6JN4CEVIMXISMNQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: <nil> Feb 27 11:25:38.196595246 (231h9m38.999954428s) [noise=true , address=145.79.227.34:4908 , piece_id=7K2XFLKLIBANQ5X7ORGCTFXXS3G4UX7IARVJNMV3DIEE6YYVXFRA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2, address:145.79.227.34:4908): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.196789540 (231h9m39.00014872s) [noise=true , address=145.79.227.2:4113 , piece_id=YPQRTPFUYADTTB3NQ7663YB4L2OBYBFWSJZZJTU3KR4MPJ7BOL6Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.196851000 (231h9m39.000210183s) [noise=true , address=145.79.227.24:4586 , piece_id=Z6LNTX2YAEASOHV3P2H3RRCW33OV53VOFKYRS746SZMH7LMS3LFA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1mkxgR2oLXcTdyCsxmR9Q1an9ZeLgkTSHRCtR4ZJqKbsStNEMh, address:145.79.227.24:4586): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197036340 (231h9m39.000395523s) [noise=true , address=145.79.227.43:4163 , piece_id=DNVOWRD65WSY5U2GA6VHHRJ7ACOJD2OKIWKEYONZNQHMPXIHE7TQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12CgPQ5hkrJdqbJvGarxKjXvYYnrXQqapL5BH2rNJNvnhpRi3pw, address:145.79.227.43:4163): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197122039 (231h9m39.000481226s) [noise=true , address=145.79.227.3:4149 , piece_id=PFJ2KUAQNUI3P2XMTDTR5R3N7LHOAJUY2TAYCWHON6OFA2X64WAA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm, address:145.79.227.3:4149): protocol: rpc: dial tcp 145.79.227.3:4149: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197237610 (231h9m39.000596801s) [noise=true , address=145.79.227.8:4334 , piece_id=PU4GGQQNLIUSUZ6SKIIQEMXF6VRWQ5MYNZM7BGXWBMFAAEPRY27Q, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12KYMZAFsJbhWC4CdKRod2Z6qsC6ANcpqmpWSWx7UYajp6JvKH1, address:145.79.227.8:4334): protocol: rpc: dial tcp 145.79.227.8:4334: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197315309 (231h9m39.000674486s) [noise=true , address=145.79.227.37:4570 , piece_id=M5VIGFG7YMWLSPVKFZ4WWMROZ2MOTGUBFZ2IVQXNGKPNACD3I6GQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1q5evYAfULsn19ddsAvSzJwxiDd8wsWbjP6gpcRkuU1b1q57eJ, address:145.79.227.37:4570): protocol: rpc: dial tcp 145.79.227.37:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197369655 (231h9m39.000728834s) [noise=true , address=145.79.227.47:4269 , piece_id=6VOX3KV7RKVIW5WKJHHGTTHHYS6IZEAWOIUHEQ7N54K6TSUNTHXA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9, address:145.79.227.47:4269): protocol: rpc: dial tcp 145.79.227.47:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197429870 (231h9m39.00078905s) [noise=true , address=145.79.227.14:4838 , piece_id=RC4QGTA53XEYELXN7JJCKUQEP4PG5KWGOK2BGOB7QNOIL24NAY5A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197527205 (231h9m39.000886389s) [noise=true , address=145.79.227.20:4441 , piece_id=EBWYUU24YCGNNFMPXBG2AGGCBZO6U2TO3H24REMDJ5CCBYD4PJ3A, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12LjGecRNJE1kq67iMtxZFhWeaUZpUogsGxbz4VXwnHdQtTnbBr, address:145.79.227.20:4441): protocol: rpc: dial tcp 145.79.227.20:4441: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197594741 (231h9m39.000953927s) [noise=true , address=145.79.227.41:4088 , piece_id=LS2LNKW7NZGRDSSQLLC3A5M6CQOM4HZ56YNM33WCGGZWNPOHQVKA, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj, address:145.79.227.41:4088): protocol: rpc: dial tcp 145.79.227.41:4088: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197724071 (231h9m39.001083254s) [noise=true , address=145.79.227.30:4765 , piece_id=UGZWD4JKJP35DRHTBWZAUY47SZIUKLLQ5TA4N64H7XXB7LZAS5PQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:12SRRQBu9efFwqpKMvLBQhaZ9s3XQXVekdmefCBXuQPgRdik2QT, address:145.79.227.30:4765): protocol: rpc: dial tcp 145.79.227.30:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 27 11:25:38.197807574 (231h9m39.001166753s) [noise=true , address=145.79.227.32:4835 , piece_id=EWV7RJMGYNVDZXCXA73PIYUTREEYAGCHCN3VHA4TC7DUIXOSPJZQ, seg_pos={0 0}, upload=240619]: Done uploading piece. err: ecclient: upload failed (node:16vVfeoqCkbMYCRjMMWaKBnCvQBBJPMgwQtWTq9HKQrD9SS17y, address:145.79.227.32:4835): protocol: context deadline exceeded; context deadline exceeded Feb 27 11:25:38.197838000 (231h9m39.001197167s) [seg_pos={0 0}, upload=240619]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Feb 27 11:25:38.229264710 (231h9m39.032623889s) [upload=240619]: Done uploading segments... Feb 27 11:25:38.229305917 (231h9m39.032665092s) [upload=240619]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 15.780545345s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 13.927529ms remote: "tcp:136.0.77.3:443" response headers: Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189816D6F9CCB8CC Date=Fri, 27 Feb 2026 11:26:05 GMT Accept-Ranges=bytes Vary=Origin X-Request-Id=jQDHCZk3ALH X-Xss-Protection=1; mode=block target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace: https://jaeger.dev.storj.io/trace/be64c92501f02e7 FAIL (2026-02-27 11:26:05 UTC) orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189816D6F9CCB8CC</RequestId><HostId></HostId></Error>" Duration: 13.95295ms edge gateway vhost bgp us1

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)