Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.052961ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:02:44 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=FHMqLPnsaDf Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982FC23444105B target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/24e87c9a7abdec24
FAIL (2026-02-27 19:02:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FC23444105B</RequestId><HostId></HostId></Error>"
Duration: 28.078324ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.236079ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18982FC1191F48D6 X-Request-Id=99pUd5RWqmg X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:02:39 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6d900fa284929251
FAIL (2026-02-27 19:02:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FC1191F48D6</RequestId><HostId></HostId></Error>"
Duration: 11.342457ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.159652637s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 19:02:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.159673705s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.044256ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=jQJPqRHmefv Content-Length=274 X-Amz-Request-Id=18982FBE5CC946ED X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:02:28 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/aa10fba8f50f7dd
FAIL (2026-02-27 19:02:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FBE5CC946ED</RequestId><HostId></HostId></Error>"
Duration: 10.067329ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.643763ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982FBD902D7A65 X-Request-Id=2tmKjhMg7t3 Date=Fri, 27 Feb 2026 19:02:24 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1973b9b8f7742ce1
FAIL (2026-02-27 19:02:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FBD902D7A65</RequestId><HostId></HostId></Error>"
Duration: 10.68689ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.542565ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=ieFPjjmM3Nw X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 19:01:59 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18982FB7A3E3F566 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/cbe10a24c190dad
FAIL (2026-02-27 19:01:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FB7A3E3F566</RequestId><HostId></HostId></Error>"
Duration: 30.581083ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.754812ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982FB6E4B3DEB1 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=ea1z3N6S5nT Date=Fri, 27 Feb 2026 19:01:55 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/48735e86a20f3b35
FAIL (2026-02-27 19:01:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FB6E4B3DEB1</RequestId><HostId></HostId></Error>"
Duration: 14.779637ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.057566475s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 19:01:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.057608463s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.783334ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 19:01:18 GMT Accept-Ranges=bytes Content-Length=274 X-Request-Id=fnRD55jnL2M X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982FAE25A77404 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/63238867333ae1de
FAIL (2026-02-27 19:01:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FAE25A77404</RequestId><HostId></HostId></Error>"
Duration: 9.807759ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.615149ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=18982FADE568702E X-Request-Id=bvWF9u8YfaJ Date=Fri, 27 Feb 2026 19:01:17 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/33d087a568627d83
FAIL (2026-02-27 19:01:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FADE568702E</RequestId><HostId></HostId></Error>"
Duration: 8.630882ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.008411ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18982FA95B0A5C33 X-Request-Id=Q8yPZDsRJvC X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:00:57 GMT Accept-Ranges=bytes Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2bef7910a8918a82
FAIL (2026-02-27 19:00:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FA95B0A5C33</RequestId><HostId></HostId></Error>"
Duration: 31.048409ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.115075269s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 19:00:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.115125773s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.878909ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:00:55 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982FA8B7394081 X-Request-Id=V2uXpGMb7Zz target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7310d20f4842cd47
FAIL (2026-02-27 19:00:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FA8B7394081</RequestId><HostId></HostId></Error>"
Duration: 11.892954ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.720362ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=E4kUcZ8CuiU X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982FA83AB0B92A Date=Fri, 27 Feb 2026 19:00:52 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4e7d4a17649c22b4
FAIL (2026-02-27 19:00:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FA83AB0B92A</RequestId><HostId></HostId></Error>"
Duration: 12.746533ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.194922ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=Mw9CoDsjTNk X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:00:38 GMT Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982FA4E25183A9 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/62239a22b0743061
FAIL (2026-02-27 19:00:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982FA4E25183A9</RequestId><HostId></HostId></Error>"
Duration: 13.223837ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.125248236s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 19:00:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.125340082s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.915784ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18982F9E3330BE27 X-Request-Id=KY82KNRBfmc X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 19:00:09 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Accept-Ranges=bytes Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2282e019da008b8d
FAIL (2026-02-27 19:00:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F9E3330BE27</RequestId><HostId></HostId></Error>"
Duration: 9.941626ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.910227ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 X-Amz-Request-Id=18982F9BA8DBD1EE X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=X9MPTSiXPH Date=Fri, 27 Feb 2026 18:59:58 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3822c7e07ef4001d
FAIL (2026-02-27 18:59:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F9BA8DBD1EE</RequestId><HostId></HostId></Error>"
Duration: 26.935669ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.037744ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Request-Id=efkKUwGof8n X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:59:56 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982F9B0C593B53 Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3f8c1cdfb3059a9f
FAIL (2026-02-27 18:59:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F9B0C593B53</RequestId><HostId></HostId></Error>"
Duration: 9.158013ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.146236423s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:59:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.146263302s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.061524ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982F991A276298 X-Request-Id=99UnbSNpfy2 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:59:47 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/52f9384c8b4c5052
FAIL (2026-02-27 18:59:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F991A276298</RequestId><HostId></HostId></Error>"
Duration: 16.153775ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.59785ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982F9552A2A279 X-Request-Id=NsnJ5CSk9kT X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 18:59:31 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3b32a361e82cc863
FAIL (2026-02-27 18:59:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F9552A2A279</RequestId><HostId></HostId></Error>"
Duration: 29.694885ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.337763ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=cWZBgtM91CC X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982F8E937B16D0 Date=Fri, 27 Feb 2026 18:59:02 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5b9a6cf9e70d764
FAIL (2026-02-27 18:59:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F8E937B16D0</RequestId><HostId></HostId></Error>"
Duration: 13.3637ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.192415ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18982F8C53C450F0 X-Request-Id=77wAGV2oA36 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Vary=Origin Date=Fri, 27 Feb 2026 18:58:53 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/296f2b2addb62503
FAIL (2026-02-27 18:58:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F8C53C450F0</RequestId><HostId></HostId></Error>"
Duration: 10.218311ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.047512367s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:58:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.047542582s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.158696ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18982F88B1661B42 Date=Fri, 27 Feb 2026 18:58:37 GMT Content-Length=274 X-Request-Id=MawcoWbxFtp X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/55c99a61d481c488
FAIL (2026-02-27 18:58:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F88B1661B42</RequestId><HostId></HostId></Error>"
Duration: 15.183065ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.361959ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Amz-Request-Id=18982F87DC9AC35E X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=5A8qo8UieWW Date=Fri, 27 Feb 2026 18:58:33 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/52bd264f003afdba
FAIL (2026-02-27 18:58:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F87DC9AC35E</RequestId><HostId></HostId></Error>"
Duration: 32.385879ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.019037ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982F852C2D370B Date=Fri, 27 Feb 2026 18:58:22 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=83ptZ6fd4GB X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/72da9a79df402a14
FAIL (2026-02-27 18:58:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F852C2D370B</RequestId><HostId></HostId></Error>"
Duration: 10.044638ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.112932671s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:58:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.11298551s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.351685ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982F7D82B57221 X-Request-Id=NebMnGNtQZ6 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:57:49 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7cdc1164f0cb345d
FAIL (2026-02-27 18:57:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F7D82B57221</RequestId><HostId></HostId></Error>"
Duration: 30.37897ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.731786ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=ALGFigr1MqQ X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982F7D35E5B7E0 Date=Fri, 27 Feb 2026 18:57:48 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/49865a8810495546
FAIL (2026-02-27 18:57:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F7D35E5B7E0</RequestId><HostId></HostId></Error>"
Duration: 11.754469ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.22589ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982F7B9B810020 X-Request-Id=SvLGHkTzL9g X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Vary=Origin Date=Fri, 27 Feb 2026 18:57:41 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5bbfa36a96d4aa10
FAIL (2026-02-27 18:57:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F7B9B810020</RequestId><HostId></HostId></Error>"
Duration: 13.25249ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.70283ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18982F785547F1EF X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Request-Id=MLVbebMog71 Date=Fri, 27 Feb 2026 18:57:27 GMT Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/fa0f665034fe39e
FAIL (2026-02-27 18:57:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F785547F1EF</RequestId><HostId></HostId></Error>"
Duration: 30.7431ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.425525ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982F74F7FD7E17 X-Request-Id=WqfU4wEtd7w Date=Fri, 27 Feb 2026 18:57:12 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7ad1fe902c67ccfa
FAIL (2026-02-27 18:57:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F74F7FD7E17</RequestId><HostId></HostId></Error>"
Duration: 11.451958ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.07599981s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:57:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.07602916s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.954861ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 X-Amz-Request-Id=18982F73136141B2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=egR6Lr8ddex Date=Fri, 27 Feb 2026 18:57:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/48e94edc1132a6c5
FAIL (2026-02-27 18:57:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F73136141B2</RequestId><HostId></HostId></Error>"
Duration: 9.98106ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.884539ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 18:56:34 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982F6C0AE889EE Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=SmL84jzcqHg X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6396114e0d6c4bf7
FAIL (2026-02-27 18:56:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F6C0AE889EE</RequestId><HostId></HostId></Error>"
Duration: 13.980508ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.79233ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:56:28 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Amz-Request-Id=18982F6AACF6BFA8 X-Request-Id=gMfwdgVb3Kv target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4de5ae6dfd30d6e7
FAIL (2026-02-27 18:56:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F6AACF6BFA8</RequestId><HostId></HostId></Error>"
Duration: 28.81959ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.945144ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982F64E8379D69 Content-Type=application/xml Server=Storj X-Request-Id=gWvbcH4ezy X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:56:03 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6fdacfac56ec159c
FAIL (2026-02-27 18:56:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F64E8379D69</RequestId><HostId></HostId></Error>"
Duration: 12.969464ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.071791543s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:56:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.071870651s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.205611ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18982F6447C81328 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:56:01 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=bLcYuGXwgGx Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/41cc1c8e491712a9
FAIL (2026-02-27 18:56:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F6447C81328</RequestId><HostId></HostId></Error>"
Duration: 12.220348ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.505362ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:56:00 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982F640C0DC7E5 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=2PHRSo95Kju target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3c80bcebd9a2e182
FAIL (2026-02-27 18:56:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F640C0DC7E5</RequestId><HostId></HostId></Error>"
Duration: 12.534764ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.136881ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18982F6353295A50 X-Request-Id=cKWrveZHUxo Date=Fri, 27 Feb 2026 18:55:57 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3f88d51b1122534d
FAIL (2026-02-27 18:55:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F6353295A50</RequestId><HostId></HostId></Error>"
Duration: 27.164918ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.13376ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=9KdYsC8U4qj Date=Fri, 27 Feb 2026 18:55:44 GMT Server=Storj Vary=Origin X-Amz-Request-Id=18982F606017DEA2 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1e742a72e8e51f7a
FAIL (2026-02-27 18:55:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F606017DEA2</RequestId><HostId></HostId></Error>"
Duration: 13.215284ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.609999ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982F5EC7E7E730 Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin X-Request-Id=UCRNLAxb8be X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:55:37 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6b1e739608634063
FAIL (2026-02-27 18:55:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F5EC7E7E730</RequestId><HostId></HostId></Error>"
Duration: 27.631349ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.113356284s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:55:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.113400476s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.52407ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Request-Id=arbqvHjTUBJ Date=Fri, 27 Feb 2026 18:55:19 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18982F5AA56EFE7A X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/48a8e0fae959ff2a
FAIL (2026-02-27 18:55:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F5AA56EFE7A</RequestId><HostId></HostId></Error>"
Duration: 28.549466ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.663797ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=dVemVmZ7eUR X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:55:12 GMT Server=Storj Vary=Origin X-Amz-Request-Id=18982F58F41FEC11 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/602839273abcdc8f
FAIL (2026-02-27 18:55:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F58F41FEC11</RequestId><HostId></HostId></Error>"
Duration: 12.711089ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.161677796s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:54:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.161714891s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.305237ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982F542FC06A8F X-Request-Id=GUoL1rqzbLj Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:54:51 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/532d3c3c4d4fb9e5
FAIL (2026-02-27 18:54:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982F542FC06A8F</RequestId><HostId></HostId></Error>"
Duration: 10.330149ms
edge
gateway
vhost
bgp
ap1
|