Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.018709ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 18:49:31 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982F09A811BC02 X-Request-Id=VmEdtFTm8Lr X-Xss-Protection=1; mode=block Content-Length=284 Content-Type=application/xml Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/54104575fef92cda
FAIL (2026-02-27 18:49:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F09A811BC02</RequestId><HostId></HostId></Error>"
Duration: 30.045898ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.123012ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Content-Type=application/xml X-Amz-Request-Id=18982F01BEC9DCF7 X-Request-Id=6PRPY6rXyzH X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:48:57 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2407062790336f7a
FAIL (2026-02-27 18:48:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F01BEC9DCF7</RequestId><HostId></HostId></Error>"
Duration: 13.146707ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....X......................X................................] duration:
2.188000431s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:48:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.188029722s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.352775ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18982EFDA5870612 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=DC57aw9tF9A X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:48:40 GMT Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/38c48e6df3fe3213
FAIL (2026-02-27 18:48:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EFDA5870612</RequestId><HostId></HostId></Error>"
Duration: 12.381244ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.809087ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982EFB304C2D31 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:48:29 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Request-Id=gEcyirdnKLo target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/480dfd8ce00b6c0c
FAIL (2026-02-27 18:48:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EFB304C2D31</RequestId><HostId></HostId></Error>"
Duration: 30.835691ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.390155ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=BiKBjGq8EhH X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:48:29 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982EFB1C29C9C8 Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5a95520ae2376e51
FAIL (2026-02-27 18:48:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EFB1C29C9C8</RequestId><HostId></HostId></Error>"
Duration: 11.424333ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.105833ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=Hiht1dz6jP6 Content-Length=274 Vary=Origin X-Amz-Request-Id=18982EF597CE4CA6 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:48:05 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2e62a7e3ebdfd2bb
FAIL (2026-02-27 18:48:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EF597CE4CA6</RequestId><HostId></HostId></Error>"
Duration: 16.170525ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.074864ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982EF1BA1E5F4B X-Request-Id=UaYKFfrLfDr Date=Fri, 27 Feb 2026 18:47:49 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2d6b7166a2a7cb42
FAIL (2026-02-27 18:47:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EF1BA1E5F4B</RequestId><HostId></HostId></Error>"
Duration: 11.172608ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....X......................X...............................] duration:
2.135037991s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:47:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.135061685s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.86981ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18982EECE3D34392 X-Request-Id=6XLJUtPjiHx X-Xss-Protection=1; mode=block Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 18:47:28 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3bef1b548754ff41
FAIL (2026-02-27 18:47:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EECE3D34392</RequestId><HostId></HostId></Error>"
Duration: 12.915942ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.410913ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 18:47:24 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes Content-Length=284 X-Amz-Request-Id=18982EEBE4E875E5 X-Request-Id=EWDzhhcMLym X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/14056f91f08e3567
FAIL (2026-02-27 18:47:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EEBE4E875E5</RequestId><HostId></HostId></Error>"
Duration: 30.435887ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.12894ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18982EEB032505B8 X-Xss-Protection=1; mode=block Server=Storj Vary=Origin X-Request-Id=7CAr5NXNg8x Date=Fri, 27 Feb 2026 18:47:20 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/268cc40ff2ba37ac
FAIL (2026-02-27 18:47:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EEB032505B8</RequestId><HostId></HostId></Error>"
Duration: 14.221837ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......X......................X..............................] duration:
2.110181596s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:47:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.110207574s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.297765ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj X-Amz-Request-Id=18982EE525438043 X-Request-Id=APkUkeXaBY5 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:46:55 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4a6b01f03a48dcc5
FAIL (2026-02-27 18:46:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EE525438043</RequestId><HostId></HostId></Error>"
Duration: 10.323863ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.698921ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982EE2861F2447 X-Request-Id=6Sicyq1jgJt Date=Fri, 27 Feb 2026 18:46:43 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/16f3606b7b61a924
FAIL (2026-02-27 18:46:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EE2861F2447</RequestId><HostId></HostId></Error>"
Duration: 10.796307ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.610049ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=ZRVZZKCXH5m Date=Fri, 27 Feb 2026 18:46:31 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982EDF8E7F4E23 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4f7a80b052f0155
FAIL (2026-02-27 18:46:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EDF8E7F4E23</RequestId><HostId></HostId></Error>"
Duration: 9.634628ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.998467ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982EDEC119C04E X-Request-Id=5fSLW2uNdQo Date=Fri, 27 Feb 2026 18:46:27 GMT Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3f1a9cb022811ff9
FAIL (2026-02-27 18:46:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EDEC119C04E</RequestId><HostId></HostId></Error>"
Duration: 13.025873ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.......X......................X.............................] duration:
2.097995769s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:46:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.098029269s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.154981ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982EDA7027F2F3 X-Request-Id=iW3rQej5Utn Content-Length=284 Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:46:09 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3bb30956fc43aca8
FAIL (2026-02-27 18:46:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EDA7027F2F3</RequestId><HostId></HostId></Error>"
Duration: 33.353361ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.733888ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982ED890B23CF1 X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj X-Request-Id=18LYmuJiZLa Date=Fri, 27 Feb 2026 18:46:01 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/63009de29bc91b8c
FAIL (2026-02-27 18:46:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ED890B23CF1</RequestId><HostId></HostId></Error>"
Duration: 12.763824ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.889047ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982ED6C2FE98CA X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Request-Id=2nUJuf3JtkV Date=Fri, 27 Feb 2026 18:45:53 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/668ff64bc27a92cb
FAIL (2026-02-27 18:45:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ED6C2FE98CA</RequestId><HostId></HostId></Error>"
Duration: 10.935296ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.575256ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 18:45:42 GMT Accept-Ranges=bytes X-Request-Id=WLwfzJh5TLG Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982ED454A24FB6 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7fe488920176d49c
FAIL (2026-02-27 18:45:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ED454A24FB6</RequestId><HostId></HostId></Error>"
Duration: 11.600725ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.007412ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982ED40F9A33DF X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:45:41 GMT Content-Length=274 Content-Type=application/xml X-Request-Id=SyqQ479QRN2 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4bb529fc195aed93
FAIL (2026-02-27 18:45:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ED40F9A33DF</RequestId><HostId></HostId></Error>"
Duration: 13.029956ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [........X......................X............................] duration:
2.071370131s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:45:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.071473934s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.871465ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml X-Request-Id=5K36ErHvRVU X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982ECA9A7DC564 Date=Fri, 27 Feb 2026 18:45:01 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1fdbb631654f576b
FAIL (2026-02-27 18:45:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ECA9A7DC564</RequestId><HostId></HostId></Error>"
Duration: 29.902888ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.495034ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Request-Id=K2HBpEYujGk Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982ECA8F86D95F X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:45:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/27450b309960f1ed
FAIL (2026-02-27 18:45:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ECA8F86D95F</RequestId><HostId></HostId></Error>"
Duration: 14.542837ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.730646ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=NyzqH3sCEvd Date=Fri, 27 Feb 2026 18:44:59 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982ECA51CE02D7 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3c8bb73cdacfc47
FAIL (2026-02-27 18:44:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982ECA51CE02D7</RequestId><HostId></HostId></Error>"
Duration: 9.841626ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.060819ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Request-Id=JDJmnStcpD Date=Fri, 27 Feb 2026 18:44:53 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982EC8BC862375 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4619d5d41e9b67dc
FAIL (2026-02-27 18:44:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EC8BC862375</RequestId><HostId></HostId></Error>"
Duration: 13.089627ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration:
2.123769064s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:44:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.123865112s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.088276ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982EC21F9A6530 X-Request-Id=NMdC5bMYC5b X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:44:24 GMT Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4dbfc6e05b305bcf
FAIL (2026-02-27 18:44:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EC21F9A6530</RequestId><HostId></HostId></Error>"
Duration: 27.112779ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration:
2.095754952s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:44:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.095777686s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.066457ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 X-Request-Id=73bfgQq3FVG X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:44:08 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982EBE4A6CB1E7 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/227659faf084746
FAIL (2026-02-27 18:44:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EBE4A6CB1E7</RequestId><HostId></HostId></Error>"
Duration: 27.151103ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.116463ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=4oqYwjMAjxQ Date=Fri, 27 Feb 2026 18:43:57 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=18982EBBDB0B24D8 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4ed1aec2ce86682f
FAIL (2026-02-27 18:43:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EBBDB0B24D8</RequestId><HostId></HostId></Error>"
Duration: 10.140386ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.398726ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982EBA54A3DBA6 X-Request-Id=VpzuxEyHZwh Date=Fri, 27 Feb 2026 18:43:51 GMT Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7d3a8cb2267cc419
FAIL (2026-02-27 18:43:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EBA54A3DBA6</RequestId><HostId></HostId></Error>"
Duration: 12.44187ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.020337ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:43:42 GMT Content-Type=application/xml X-Amz-Request-Id=18982EB84DCBAE44 X-Request-Id=P426sFG7QfQ Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/71eb1be7168a5ad8
FAIL (2026-02-27 18:43:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EB84DCBAE44</RequestId><HostId></HostId></Error>"
Duration: 12.038771ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.260828ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982EB6EFA49F29 Date=Fri, 27 Feb 2026 18:43:36 GMT Content-Length=274 Content-Type=application/xml X-Request-Id=4tvDeMWNotx X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2b510322660b1d86
FAIL (2026-02-27 18:43:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EB6EFA49F29</RequestId><HostId></HostId></Error>"
Duration: 14.357785ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...........X......................X.........................] duration:
2.085585986s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:43:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.085619919s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.730209ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982EB23E96847D X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:43:16 GMT Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=C4sUmExPzdW target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1381b670895ceb92
FAIL (2026-02-27 18:43:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EB23E96847D</RequestId><HostId></HostId></Error>"
Duration: 9.754956ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [............X......................X........................] duration:
2.403332206s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:43:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.403362503s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.486459ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982EAF42A1F306 X-Request-Id=MZ227DbKHwk X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Fri, 27 Feb 2026 18:43:03 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/772ccf4d449a8e70
FAIL (2026-02-27 18:43:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EAF42A1F306</RequestId><HostId></HostId></Error>"
Duration: 10.533486ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.779771ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 18:43:00 GMT Vary=Origin X-Amz-Request-Id=18982EAE976AD461 X-Request-Id=4qryefKXmTW X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/37adffec4c8c3e25
FAIL (2026-02-27 18:43:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EAE976AD461</RequestId><HostId></HostId></Error>"
Duration: 28.802625ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.583817ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Date=Fri, 27 Feb 2026 18:42:38 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=18982EA979863997 X-Request-Id=csHsEwQXbpz X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/74b2c63526312508
FAIL (2026-02-27 18:42:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EA979863997</RequestId><HostId></HostId></Error>"
Duration: 15.609474ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.84994ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:42:33 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982EA8527D4FBF X-Request-Id=aEiNuRbjjES target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7464ba99aa90778d
FAIL (2026-02-27 18:42:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EA8527D4FBF</RequestId><HostId></HostId></Error>"
Duration: 26.877109ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.968868ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18982EA63AFBE1CB X-Request-Id=QQTeDzgxaRJ Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:42:24 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/8305cbb69bfdb3b
FAIL (2026-02-27 18:42:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982EA63AFBE1CB</RequestId><HostId></HostId></Error>"
Duration: 9.996199ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration:
2.470438633s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:42:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.470469236s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.689793ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982E9FE2BE12F0 X-Request-Id=3ZQ15GCBRbp X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:41:57 GMT Content-Type=application/xml Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3ef019eafd9bdb91
FAIL (2026-02-27 18:41:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E9FE2BE12F0</RequestId><HostId></HostId></Error>"
Duration: 32.717784ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.857202ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E9E53D2539D X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:41:50 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=YLf1D9i81Vp target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/49510bfffde4e75f
FAIL (2026-02-27 18:41:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E9E53D2539D</RequestId><HostId></HostId></Error>"
Duration: 12.925253ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.735623ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Content-Length=274 X-Amz-Request-Id=18982E9DC3486147 X-Request-Id=gxdSjuxK7Qw X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:41:48 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/195d98239f03d30b
FAIL (2026-02-27 18:41:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E9DC3486147</RequestId><HostId></HostId></Error>"
Duration: 9.763955ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.826315ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E9D53E49C46 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:41:46 GMT Content-Type=application/xml Server=Storj X-Request-Id=ZcVYNwf2oDT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/20d30c58a196190a
FAIL (2026-02-27 18:41:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E9D53E49C46</RequestId><HostId></HostId></Error>"
Duration: 14.857724ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..............X......................X......................] duration:
2.090958514s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:41:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.091000131s
core
uplink
eu-select-1
eu1-placement-15
|