Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.055647ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 18:41:17 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982E969170C891 X-Request-Id=DKCxWpLuDQp target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7772ad31041e98be
FAIL (2026-02-27 18:41:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E969170C891</RequestId><HostId></HostId></Error>"
Duration: 11.082544ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.767399ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E958F996559 Date=Fri, 27 Feb 2026 18:41:13 GMT Content-Type=application/xml Server=Storj X-Request-Id=JGW4roXz8ty X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3671ffaa3eb43a0f
FAIL (2026-02-27 18:41:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E958F996559</RequestId><HostId></HostId></Error>"
Duration: 29.800796ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...............X......................X.....................] duration:
2.074623496s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:41:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.074735176s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.495881ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=gwQmrL2PibX X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:41:08 GMT Content-Length=274 Vary=Origin X-Amz-Request-Id=18982E948E97CA2D Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/19b2729c44888376
FAIL (2026-02-27 18:41:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E948E97CA2D</RequestId><HostId></HostId></Error>"
Duration: 9.588487ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.608185ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Content-Type=application/xml X-Amz-Request-Id=18982E921402F0A6 X-Request-Id=aj6L8ZmXDuW X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:40:58 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/49910f7b9b5a4248
FAIL (2026-02-27 18:40:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E921402F0A6</RequestId><HostId></HostId></Error>"
Duration: 10.631865ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.622136ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982E910C6CD23A Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=SdN2BAyYbvM X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:40:53 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/10eb9d18ae9cdd06
FAIL (2026-02-27 18:40:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E910C6CD23A</RequestId><HostId></HostId></Error>"
Duration: 14.65161ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [................X......................X....................] duration:
2.467711397s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:40:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.467743233s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.771423ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982E8CF9E9FC77 Date=Fri, 27 Feb 2026 18:40:36 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=KdzZwdt6tQd X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/77b70c903e5b48aa
FAIL (2026-02-27 18:40:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E8CF9E9FC77</RequestId><HostId></HostId></Error>"
Duration: 28.79759ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.64601ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Request-Id=d2hFJD7pL3X Date=Fri, 27 Feb 2026 18:40:12 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982E87658D70C8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/53a20d0b1057f986
FAIL (2026-02-27 18:40:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E87658D70C8</RequestId><HostId></HostId></Error>"
Duration: 11.676616ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.223937ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=5pzSLutvJb1 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982E86FD26CD2F X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:40:10 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/d2bc8c79cb9f84
FAIL (2026-02-27 18:40:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E86FD26CD2F</RequestId><HostId></HostId></Error>"
Duration: 12.316509ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.510812ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Fri, 27 Feb 2026 18:40:06 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982E8600D86C04 X-Request-Id=XReSqD3K1FL X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/65097186c1029cd9
FAIL (2026-02-27 18:40:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E8600D86C04</RequestId><HostId></HostId></Error>"
Duration: 10.537701ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.463282ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18982E8249D142ED X-Request-Id=8zmmJ7kqsUS Date=Fri, 27 Feb 2026 18:39:50 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2059aa1c3b1ace3
FAIL (2026-02-27 18:39:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E8249D142ED</RequestId><HostId></HostId></Error>"
Duration: 29.49081ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.762908ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=ZUd7ZwGpLhA X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:39:44 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18982E80D1DC3DDA target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1c12de6e33b7f5a7
FAIL (2026-02-27 18:39:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E80D1DC3DDA</RequestId><HostId></HostId></Error>"
Duration: 9.788305ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.03845ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E7F6EE971C1 Content-Type=application/xml X-Request-Id=QYdH2kwTCWm X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:39:38 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/419ca86e58c15428
FAIL (2026-02-27 18:39:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E7F6EE971C1</RequestId><HostId></HostId></Error>"
Duration: 14.077531ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.................X......................X...................] duration:
2.05905397s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:39:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.059081463s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.498406ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 18:39:09 GMT Content-Type=application/xml X-Amz-Request-Id=18982E78C89D5AB9 X-Request-Id=DkdrSPRjbF3 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/50c42ce566693997
FAIL (2026-02-27 18:39:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E78C89D5AB9</RequestId><HostId></HostId></Error>"
Duration: 10.527921ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..................X......................X..................] duration:
2.104483556s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:39:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.104509659s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.190326ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=18982E763391ACB4 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=9mcLmQSwLZf X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:58 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7d817eb4e0e4dc19
FAIL (2026-02-27 18:38:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E763391ACB4</RequestId><HostId></HostId></Error>"
Duration: 10.21359ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.531168ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=EJUBU8sj8ia X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:55 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982E756F354F8D target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6889cd5b01b36dfc
FAIL (2026-02-27 18:38:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E756F354F8D</RequestId><HostId></HostId></Error>"
Duration: 27.554841ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.600077ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:36 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E710345498D X-Request-Id=FCD8uuifArC target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/684b4863e9856d76
FAIL (2026-02-27 18:38:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E710345498D</RequestId><HostId></HostId></Error>"
Duration: 28.624528ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.627599ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18982E7104ABEF20 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:36 GMT Content-Type=application/xml Vary=Origin X-Request-Id=cRQRyYucpse target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/60e1f364b573d2f4
FAIL (2026-02-27 18:38:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E7104ABEF20</RequestId><HostId></HostId></Error>"
Duration: 9.651628ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.722662ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=RTW37PpYc6Y X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:26 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982E6EC50F2BBB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/e6ccdb76908d1ea
FAIL (2026-02-27 18:38:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E6EC50F2BBB</RequestId><HostId></HostId></Error>"
Duration: 11.801261ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.379273ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18982E6E6F2A2D48 Accept-Ranges=bytes X-Request-Id=EDhqzFk9u6H X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:25 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/245ac119899cf3f5
FAIL (2026-02-27 18:38:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E6E6F2A2D48</RequestId><HostId></HostId></Error>"
Duration: 19.404758ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.507603ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 18:38:18 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982E6CFAEDDC9A Server=Storj X-Request-Id=NJ4ZHbQ4BBj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5c5b647e458a543c
FAIL (2026-02-27 18:38:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E6CFAEDDC9A</RequestId><HostId></HostId></Error>"
Duration: 28.537476ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.832184ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=UqDjaKiuokL Content-Length=274 Server=Storj X-Amz-Request-Id=18982E6C17B2BAF4 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:38:15 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/76582d314a489c80
FAIL (2026-02-27 18:38:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E6C17B2BAF4</RequestId><HostId></HostId></Error>"
Duration: 10.924334ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.634466ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=JGMxZ3QEz9L X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18982E68BB9FB617 Date=Fri, 27 Feb 2026 18:38:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/298891f7b7732596
FAIL (2026-02-27 18:38:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E68BB9FB617</RequestId><HostId></HostId></Error>"
Duration: 10.678387ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...................X......................X.................] duration:
2.113376996s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:37:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.113399899s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.587173ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 18:37:37 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=inYzDVt9QyE Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E6362D084C1 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1425463e1b030a77
FAIL (2026-02-27 18:37:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E6362D084C1</RequestId><HostId></HostId></Error>"
Duration: 14.611533ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.333151ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:37:32 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18982E6240FE844B X-Request-Id=eFsJ243g8tr target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/22a9e4a107859200
FAIL (2026-02-27 18:37:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E6240FE844B</RequestId><HostId></HostId></Error>"
Duration: 33.363164ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.370555ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=U1NXC3uCcUe X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:37:20 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E5F535400AE target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2c7682d142469952
FAIL (2026-02-27 18:37:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E5F535400AE</RequestId><HostId></HostId></Error>"
Duration: 9.391778ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.973386ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=dBooeRKpfpt X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:36:56 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E59BA8BBA8F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5fcb45391af324df
FAIL (2026-02-27 18:36:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E59BA8BBA8F</RequestId><HostId></HostId></Error>"
Duration: 9.998ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....................X......................X................] duration:
2.483256063s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:36:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.483285792s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.870412ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 X-Request-Id=RsEnAH9USKQ Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18982E593ABA7A5D X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:36:54 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3ceb0cb346808a2f
FAIL (2026-02-27 18:36:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E593ABA7A5D</RequestId><HostId></HostId></Error>"
Duration: 11.898049ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.818529ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Content-Length=274 Vary=Origin X-Amz-Request-Id=18982E59001DCF9E X-Request-Id=3W9yAm7vYBB X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:36:53 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1bce9eb8ec89ffe2
FAIL (2026-02-27 18:36:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E59001DCF9E</RequestId><HostId></HostId></Error>"
Duration: 10.959906ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.332353ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=FyfweqM156s Date=Fri, 27 Feb 2026 18:36:39 GMT Vary=Origin X-Amz-Request-Id=18982E55BDF6C680 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6d6d841bc64cfa72
FAIL (2026-02-27 18:36:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E55BDF6C680</RequestId><HostId></HostId></Error>"
Duration: 14.359083ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.81841ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:36:35 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18982E54E5906F0A X-Request-Id=LhGk2Jt296i target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4c409b08010e6fa5
FAIL (2026-02-27 18:36:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E54E5906F0A</RequestId><HostId></HostId></Error>"
Duration: 29.845468ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.114549ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Request-Id=Nf7FVYC4AD8 X-Xss-Protection=1; mode=block Accept-Ranges=bytes X-Amz-Request-Id=18982E50A58E23E5 Date=Fri, 27 Feb 2026 18:36:17 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4ed0f9a1acce88f1
FAIL (2026-02-27 18:36:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E50A58E23E5</RequestId><HostId></HostId></Error>"
Duration: 31.140107ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.75352ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block X-Amz-Request-Id=18982E5079B16F64 X-Request-Id=SnbjTie93FX Date=Fri, 27 Feb 2026 18:36:16 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/40d7f75c4c455bdf
FAIL (2026-02-27 18:36:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E5079B16F64</RequestId><HostId></HostId></Error>"
Duration: 9.787826ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration:
2.165493868s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:36:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.165608434s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.491286ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E4941168C61 X-Request-Id=iJVtvBBGx4Q X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Date=Fri, 27 Feb 2026 18:35:45 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/261d2cca71e0641b
FAIL (2026-02-27 18:35:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E4941168C61</RequestId><HostId></HostId></Error>"
Duration: 19.565186ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.667881ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=gEiYJXiu9Bj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E4677679E9D Date=Fri, 27 Feb 2026 18:35:33 GMT Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/aeb9d1813916763
FAIL (2026-02-27 18:35:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E4677679E9D</RequestId><HostId></HostId></Error>"
Duration: 11.690292ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.745136ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=YrAMJC793bx X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:35:32 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18982E4635537227 Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1254f21747a301e5
FAIL (2026-02-27 18:35:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E4635537227</RequestId><HostId></HostId></Error>"
Duration: 10.780936ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.526373ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E42C0D19936 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:35:17 GMT Content-Type=application/xml X-Request-Id=RGmhpp8iybL Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/c54485d3c16cb43
FAIL (2026-02-27 18:35:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E42C0D19936</RequestId><HostId></HostId></Error>"
Duration: 32.571621ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.17385ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=cScD51VFK3B X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:35:15 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18982E4236A8ED59 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/13bd9d5c702865c5
FAIL (2026-02-27 18:35:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E4236A8ED59</RequestId><HostId></HostId></Error>"
Duration: 10.202995ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......................X......................X..............] duration:
2.524853599s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:35:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.524882443s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.647788ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E3C3ECFD27F X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml X-Request-Id=7NXAtRbv7yg Date=Fri, 27 Feb 2026 18:34:49 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/b2ba093b106c24c
FAIL (2026-02-27 18:34:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E3C3ECFD27F</RequestId><HostId></HostId></Error>"
Duration: 13.664562ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.800161ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18982E386D010E1D X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=Vrb4WPhQ6UC Date=Fri, 27 Feb 2026 18:34:33 GMT Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/49172240689bb028
FAIL (2026-02-27 18:34:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E386D010E1D</RequestId><HostId></HostId></Error>"
Duration: 11.830644ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.464962ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=hTNZEXXQFuJ Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E3851B5A2BE X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 18:34:32 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5080773f9cad4aaa
FAIL (2026-02-27 18:34:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E3851B5A2BE</RequestId><HostId></HostId></Error>"
Duration: 12.56326ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.719367ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 18:34:24 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18982E3662500F09 X-Request-Id=3U6cMJWtrZW X-Xss-Protection=1; mode=block Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3e3e7695dc934bdb
FAIL (2026-02-27 18:34:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18982E3662500F09</RequestId><HostId></HostId></Error>"
Duration: 29.751446ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration:
2.142116362s trace:
https://jaeger.dev.storj.io/trace/7aa57c119569a500
FAIL (2026-02-27 18:34:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
KCFQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408102653 (238h9m9.211461838s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408567070 (238h9m9.211926247s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408707192 (238h9m9.212066378s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.408968070 (238h9m9.212327244s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409367498 (238h9m9.212726677s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.409377018 (238h9m9.212736185s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410004538 (238h9m9.213363725s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.410656413 (238h9m9.214015608s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411331444 (238h9m9.214690672s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.411885321 (238h9m9.215244506s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412446978 (238h9m9.21580616s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.412960206 (238h9m9.216319389s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Uploading piece...
Feb 27 18:25:08.833976270 (238h9m9.637335445s) [upload=247902]: Next returned nil segment
Feb 27 18:25:08.833993781 (238h9m9.637352963s) [upload=247902]: Waiting for error group managing segments...
Feb 27 18:25:09.002997616 (238h9m9.806356791s) [noise=true , address=81.171.14.70:4040 , piece_id=2MPY2M6YD4A35CALBOQBGARWAVYBWSALZU2P4JQNVTVU462KXOSQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.003988167 (238h9m9.807347334s) [noise=true , address=81.171.14.70:4037 , piece_id=O6CQWKOJPHOHZAO7PMTX74XFWNPWIDDDUE2S4NPO67A64TRGVLDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.007807120 (238h9m9.811166324s) [noise=true , address=81.171.14.70:4044 , piece_id=SX5RETWJXQ37MNWETTT3ISLFDEQMJ4LGWEWLA4SELKUG6L447YZQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.019462938 (238h9m9.822822115s) [noise=true , address=81.171.14.70:4039 , piece_id=VV7S6QSQSAMDYP2J4TWHDJNIGMTPEHG7N4737DETH4SSYKK3FKNA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.031013955 (238h9m9.834373141s) [noise=true , address=185.167.204.206:4050 , piece_id=NNXAXJUAW34ZSFMQZHSMONU2KSGJ4DNNNLGA3VCV7Q7JE4OXYUAA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.039442786 (238h9m9.84280196s) [noise=true , address=185.167.204.205:4015 , piece_id=BDAGMFUBVFEZ36P5HRXHGSVUWECNDDTT2QJ6FTYNX7LMSVP2SXDA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.050960211 (238h9m9.854319391s) [noise=true , address=81.171.14.70:4045 , piece_id=L7UHAEK27O4JZMSCYFVKZQ7GRSLYXEVMHJ4ZLMZBBJVMVPSLLZ4Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.067324682 (238h9m9.870683857s) [noise=true , address=185.167.204.206:4067 , piece_id=LMTR6XVP77QRHIFJFPK2CCNTLFVKGCNFXBN2Z4AQQTE7YTJ2PDVA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.070489496 (238h9m9.87384866s) [noise=true , address=185.167.204.205:4014 , piece_id=BARLDQMMCDLHRYMWOBXKPUIFMJDJQMMUSBTR7VVXTO23QSZDNR4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.071657801 (238h9m9.87501698s) [noise=true , address=185.167.204.206:4068 , piece_id=DRL3HHGWZQGLK5RWPTJFIOUERAFO3OH3FWGWCVCPLN3JAR7K7QPA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.072680314 (238h9m9.876039488s) [noise=true , address=185.167.204.206:4045 , piece_id=W7IVHVWDUELYXE7ZPNN7SFIZCPF4LFKDUPF55GACLTDOKJVYVB7A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.074685847 (238h9m9.878045033s) [noise=true , address=185.167.204.205:4008 , piece_id=CDKH6EYARWHKZIMNICX46Z3JSGBETOJEPGVGGESJ7LZZYGGBKKMQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.089811558 (238h9m9.893170735s) [noise=true , address=89.149.201.147:4019 , piece_id=UIBQXE4PT74V3UTDESTN5GTPOURIQZCM7EDSSMTWP67PD3TF562A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.098264180 (238h9m9.901623357s) [noise=true , address=185.167.204.206:4053 , piece_id=GOQ52CA2J4GSR7A5DXDDDMEDVHODA4FE5A6A2I3GMDSICFLSKCFQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101019345 (238h9m9.904378509s) [noise=true , address=185.167.204.205:4024 , piece_id=Z6W5YEVS5QUZSOTCZNZIOUWA6BXVH6K2AHU4ANOLSPNYUW5Y342A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.101369094 (238h9m9.904728292s) [noise=true , address=185.167.204.205:4002 , piece_id=2DSKXMEVZMV5ECFAXVPHHSK3YS5LQI3LQNTGYD3DNCHKT74VGRSA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.102365507 (238h9m9.905724671s) [noise=true , address=185.167.204.206:4041 , piece_id=JYD734S7X4QLARQFX44G24S7YXDUX3GWJ4QOY5NHD2NY5XMLVVOA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.103504275 (238h9m9.90686345s) [noise=true , address=89.149.201.147:4008 , piece_id=HY4JE6TBQ3AAXVGQNXVKIMX6MNU45UMLPK2YEH4QXC4OBKPNEWNQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.106507437 (238h9m9.909866612s) [noise=true , address=185.167.204.205:4022 , piece_id=YQ2KZ4DBITY5ARO2HWCYE3ZZ2Z7754QZTWF6PVBWVYNKSNL5NPZA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.145089732 (238h9m9.948448907s) [noise=true , address=185.167.204.205:4032 , piece_id=PO5HCCJRMTU3HRJNBNVUURHUOQRIK3A44IG7IRZ5ID4X7XA2TK4A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:09.473005969 (238h9m10.276365143s) [noise=true , address=89.149.201.147:4022 , piece_id=RXOTFX6A2YXRKFIL3A2OG6TCRT3JOYKCTVQ4OU3WT37W5XZGKS3A, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:13.403656159 (238h9m14.207015334s) [noise=true , address=185.167.204.206:4059 , piece_id=RYP2J5M7ERW64IPIDS4YC6XSMXJJYFY2FIOHFFVJ4FMEZMFC45PQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:14.229596272 (238h9m15.032955449s) [noise=true , address=185.167.204.206:4071 , piece_id=S23HGNGGEWNCQP2TMJ3CH2HL4TQWMEYVDFHCYKFAHXBDAY4X6ILA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:17.197218248 (238h9m18.000577422s) [noise=true , address=185.167.204.206:4058 , piece_id=LWJRPZ4HGZUFWIR27LRPVADDKOFJ5ZTEOGD7CXXAL4N26FOHAW7Q, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:25:50.077929419 (238h9m50.881288595s) [noise=true , address=185.167.204.205:4016 , piece_id=OKVLDG74HIMGHBJNZ6GSSYIB4TRXPVLK3TFDDADE6XMW2ARDBAJA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: <nil>
Feb 27 18:26:08.034087443 (238h10m8.837446626s) [noise=true , address=89.149.201.147:4016 , piece_id=DRJK3ZPIZKZ44E6RPX6FGQZWPNMA7VMAIP6JXCB7IUQQ7QC5F7BQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: rpc: dial tcp 89.149.201.147:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034276836 (238h10m8.837636013s) [noise=true , address=185.167.204.206:4060 , piece_id=FYLUW3ZDKCKD6IYBCPF22RRPPXKQUIDMFBNXTVIV64KSOH4R77NQ, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: read tcp 159.223.143.39:60508->185.167.204.206:4060: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034741100 (238h10m8.83810028s) [noise=true , address=185.167.204.205:4017 , piece_id=CV6LFILYHABDCW25TJJ7636AOKZ36JVLJJYXBNR7V4TZW4SJ7MUA, seg_pos={0 0}, upload=247902]: Done uploading piece. err: ecclient: upload failed (node:12em75cRFPaX8jTLrVV4sbuL4AgzzHopjFfiJ6MsvvYKKGNFe8h, address:185.167.204.205:4017): protocol: read tcp 159.223.143.39:58588->185.167.204.205:4017: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 27 18:26:08.034770401 (238h10m8.838129567s) [seg_pos={0 0}, upload=247902]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 27 18:26:08.139631321 (238h10m8.942990495s) [upload=247902]: Done uploading segments...
Feb 27 18:26:08.139695418 (238h10m8.943054606s) [upload=247902]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.142146241s
core
uplink
eu-select-1
eu1-placement-15
|