Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.137634883s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:24:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.137660066s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.22116ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1896597146676BD2 Date=Sat, 21 Feb 2026 19:24:06 GMT Content-Type=application/xml X-Request-Id=8477HoMeqmv X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/63128c5da8b02b6f
FAIL (2026-02-21 19:24:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896597146676BD2</RequestId><HostId></HostId></Error>"
Duration: 26.245936ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.902559ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896596FBD61961B X-Request-Id=28UTqko9qeV X-Xss-Protection=1; mode=block Server=Storj Date=Sat, 21 Feb 2026 19:23:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/37262a7ffc3fe6da
FAIL (2026-02-21 19:23:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896596FBD61961B</RequestId><HostId></HostId></Error>"
Duration: 16.01333ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.535704ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1896596D68F0DFF1 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:23:49 GMT Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Request-Id=dea2sudfhpe Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3467c208a399cd87
FAIL (2026-02-21 19:23:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896596D68F0DFF1</RequestId><HostId></HostId></Error>"
Duration: 29.558775ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.732607ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1896596D2B1BD832 X-Request-Id=27wzVVL87sU Date=Sat, 21 Feb 2026 19:23:48 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/46ef1686a5c5cfcc
FAIL (2026-02-21 19:23:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896596D2B1BD832</RequestId><HostId></HostId></Error>"
Duration: 11.757135ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.407211ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896596C70E2BEF8 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:23:45 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=UuQLhfHDSGV target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4e586b85d9d76a4e
FAIL (2026-02-21 19:23:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896596C70E2BEF8</RequestId><HostId></HostId></Error>"
Duration: 11.427781ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.466484589s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:23:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.466511393s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.549615ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=189659651CBDB775 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Request-Id=bbUBbFG3wx4 Date=Sat, 21 Feb 2026 19:23:14 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2218adb40d29cfb0
FAIL (2026-02-21 19:23:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659651CBDB775</RequestId><HostId></HostId></Error>"
Duration: 9.579876ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.083864ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18965964A53059D8 X-Request-Id=31J7SYc4wZZ Date=Sat, 21 Feb 2026 19:23:12 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/742af0c8d5e4cdbd
FAIL (2026-02-21 19:23:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965964A53059D8</RequestId><HostId></HostId></Error>"
Duration: 18.096567ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.267349ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1896596359B9411A Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=5ATZqbK1krQ X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:23:06 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/439b65b57fc25e73
FAIL (2026-02-21 19:23:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896596359B9411A</RequestId><HostId></HostId></Error>"
Duration: 12.291558ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.600941ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=LNFkYS3Fctv X-Xss-Protection=1; mode=block Content-Length=274 Vary=Origin X-Amz-Request-Id=1896595E964A582A Date=Sat, 21 Feb 2026 19:22:46 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/196a169c143f803b
FAIL (2026-02-21 19:22:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896595E964A582A</RequestId><HostId></HostId></Error>"
Duration: 9.622167ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.154614757s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:22:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.154646682s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.460941ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=ZsoUKUoG5TW Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896595DEAC51E20 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:22:43 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/75351559178183a2
FAIL (2026-02-21 19:22:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896595DEAC51E20</RequestId><HostId></HostId></Error>"
Duration: 10.472429ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.106074ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 X-Amz-Request-Id=1896595DC2208958 Date=Sat, 21 Feb 2026 19:22:42 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=EkADtQsztpz X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/cc5dd13dc01b511
FAIL (2026-02-21 19:22:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896595DC2208958</RequestId><HostId></HostId></Error>"
Duration: 26.136978ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.520437ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18965959FC54AD88 X-Request-Id=hM7Qq2fbpBE X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:22:26 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/57f1af7fc315c90d
FAIL (2026-02-21 19:22:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965959FC54AD88</RequestId><HostId></HostId></Error>"
Duration: 29.544209ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.683016ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:22:24 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189659596DEEE4A4 X-Request-Id=VXezs2nqi54 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/b0579f6f677a626
FAIL (2026-02-21 19:22:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659596DEEE4A4</RequestId><HostId></HostId></Error>"
Duration: 14.705933ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
36.371053ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=189659598D048B5B X-Request-Id=2MXFDvBZfLe X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:22:24 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/24c90e0b87a49671
FAIL (2026-02-21 19:22:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659598D048B5B</RequestId><HostId></HostId></Error>"
Duration: 36.387235ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.190179ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18965958EF59E799 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:22:21 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=SGQmV8iqZ7J Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6dcacbe4db9a9596
FAIL (2026-02-21 19:22:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965958EF59E799</RequestId><HostId></HostId></Error>"
Duration: 10.203633ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.360879355s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:22:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.360908334s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.893636ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1896594EBA0F542B X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=WLPsS8AesGN Date=Sat, 21 Feb 2026 19:21:38 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7e01c544cf7bd977
FAIL (2026-02-21 19:21:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896594EBA0F542B</RequestId><HostId></HostId></Error>"
Duration: 15.920067ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.800601ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1896594A28D64292 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=CwYjzFkZru7 Date=Sat, 21 Feb 2026 19:21:18 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/223a2df6612bd788
FAIL (2026-02-21 19:21:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896594A28D64292</RequestId><HostId></HostId></Error>"
Duration: 10.83361ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.160607ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189659491F9055C8 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:21:14 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=D1DmaSHqiF1 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/38e0d2deb2ca0085
FAIL (2026-02-21 19:21:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659491F9055C8</RequestId><HostId></HostId></Error>"
Duration: 28.196429ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.389276ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=7zFSsMakN7A Date=Sat, 21 Feb 2026 19:21:13 GMT Accept-Ranges=bytes X-Amz-Request-Id=1896594901FE21F4 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/404a27dde6db9b07
FAIL (2026-02-21 19:21:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896594901FE21F4</RequestId><HostId></HostId></Error>"
Duration: 11.416375ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.120553864s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:21:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.120667085s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.194742ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18965943244F2BA7 X-Request-Id=14j2ZGQbp6F X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Sat, 21 Feb 2026 19:20:48 GMT Content-Length=274 Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/c73ffa4410bb96c
FAIL (2026-02-21 19:20:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965943244F2BA7</RequestId><HostId></HostId></Error>"
Duration: 15.220921ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.148936681s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:20:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.149034314s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
46.168703ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=PR32ocZMA8j X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:20:30 GMT Server=Storj X-Amz-Request-Id=1896593EE34A4765 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/10d447ff35c88e98
FAIL (2026-02-21 19:20:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896593EE34A4765</RequestId><HostId></HostId></Error>"
Duration: 46.195107ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.263166ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=bRgATgZFDj X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:20:10 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896593A56BFAD91 Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2ed72e3be5225310
FAIL (2026-02-21 19:20:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896593A56BFAD91</RequestId><HostId></HostId></Error>"
Duration: 11.360789ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.985999ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=18965938D5ED7CF4 X-Request-Id=BCtYNBd2295 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Vary=Origin Date=Sat, 21 Feb 2026 19:20:04 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7b1e94c680f070fb
FAIL (2026-02-21 19:20:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965938D5ED7CF4</RequestId><HostId></HostId></Error>"
Duration: 20.023851ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.606363ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189659366E999195 X-Request-Id=jndumu87CiJ Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:19:53 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/19ba2acb92998ef1
FAIL (2026-02-21 19:19:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659366E999195</RequestId><HostId></HostId></Error>"
Duration: 11.632659ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.81879ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Date=Sat, 21 Feb 2026 19:19:50 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18965935BE30A0F5 X-Request-Id=NMsPs1cE7me X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/e001415cd3dcc38
FAIL (2026-02-21 19:19:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965935BE30A0F5</RequestId><HostId></HostId></Error>"
Duration: 13.899641ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.35169872s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:19:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.351731589s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.510882ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1896592FECAFDD88 X-Request-Id=df3EDaf5L6P X-Xss-Protection=1; mode=block Content-Length=274 Date=Sat, 21 Feb 2026 19:19:25 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7ede6a06e1a4962f
FAIL (2026-02-21 19:19:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896592FECAFDD88</RequestId><HostId></HostId></Error>"
Duration: 10.53351ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.144688351s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:19:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.144705263s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.705278ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1896592F21FFA018 X-Request-Id=SqqiGn9MLrx X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:19:22 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/16831449a65ec995
FAIL (2026-02-21 19:19:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896592F21FFA018</RequestId><HostId></HostId></Error>"
Duration: 11.727932ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.355994ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:19:18 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896592E1EE945C9 X-Request-Id=deGsK2JHej8 Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3a92c3762fc5702c
FAIL (2026-02-21 19:19:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896592E1EE945C9</RequestId><HostId></HostId></Error>"
Duration: 29.377307ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.376022ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189659283BC585A0 X-Request-Id=FPXaJ4xo71f X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:18:52 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1b8b931160dda534
FAIL (2026-02-21 19:18:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659283BC585A0</RequestId><HostId></HostId></Error>"
Duration: 12.404086ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.156828ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=QRM7vFness8 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:18:45 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18965926833BEF92 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/670e28dffd2110b0
FAIL (2026-02-21 19:18:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965926833BEF92</RequestId><HostId></HostId></Error>"
Duration: 13.17754ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.073736ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 X-Request-Id=K5WrL7BRsv Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189659231D82117D X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:18:30 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4baf83c4f9c1677c
FAIL (2026-02-21 19:18:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659231D82117D</RequestId><HostId></HostId></Error>"
Duration: 29.109911ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.236428ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sat, 21 Feb 2026 19:18:22 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=189659211B8E9A09 X-Request-Id=XViJk9r8xc6 X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/43eb0f7f73b92077
FAIL (2026-02-21 19:18:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659211B8E9A09</RequestId><HostId></HostId></Error>"
Duration: 12.334809ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.284003109s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:18:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 2.284022461s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
44.600384273s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:18:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 44.600416833s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.707063ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sat, 21 Feb 2026 19:18:00 GMT Content-Length=274 Vary=Origin X-Request-Id=Ff4u4kXjAjr X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896591C1271A7EE target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/79fe3a5ea50bc557
FAIL (2026-02-21 19:18:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896591C1271A7EE</RequestId><HostId></HostId></Error>"
Duration: 10.730933ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.714974ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Vary=Origin X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:17:50 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18965919B805208F X-Request-Id=TcbGTb11wsR target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/538195c4d391b460
FAIL (2026-02-21 19:17:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965919B805208F</RequestId><HostId></HostId></Error>"
Duration: 11.752727ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.912615ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=DoEQpRidpLM Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18965918BAE3CBF3 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:17:46 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1ef3b07a048d1f5d
FAIL (2026-02-21 19:17:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965918BAE3CBF3</RequestId><HostId></HostId></Error>"
Duration: 15.937752ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.960033ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj X-Amz-Request-Id=189659164919FEA2 X-Request-Id=HmCzsuJckMy Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:17:35 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/45424b362921304d
FAIL (2026-02-21 19:17:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189659164919FEA2</RequestId><HostId></HostId></Error>"
Duration: 32.985933ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
12.287511301s trace:
https://jaeger.dev.storj.io/trace/1c9458c71041badd
FAIL (2026-02-21 19:17:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 22)
======LOGS======
e_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.679391886 (94h59m51.48275106s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.680372148 (94h59m51.483731338s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.681163117 (94h59m51.484522291s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.689592696 (94h59m51.492951871s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.693088681 (94h59m51.496447861s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.702332068 (94h59m51.505691249s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.704301514 (94h59m51.507660691s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:50.706734688 (94h59m51.510093868s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Uploading piece...
Feb 21 19:15:51.141369837 (94h59m51.944729011s) [upload=99019]: Next returned nil segment
Feb 21 19:15:51.141386093 (94h59m51.944745271s) [upload=99019]: Waiting for error group managing segments...
Feb 21 19:15:51.352621252 (94h59m52.155980428s) [noise=true , address=185.167.204.206:4041 , piece_id=K2OOUTE3NDABRTCCZ3NCYJUZ4E7DEVPWW3R2CG5UI4GIGSDIH3EQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.354301022 (94h59m52.157660196s) [noise=true , address=185.167.204.205:4016 , piece_id=4FUM3KJV6BCEQJBB22JIRT3EKLO7NPYQZ2FUH37ONSG32TF657PA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.371926272 (94h59m52.175285446s) [noise=true , address=185.167.204.206:4064 , piece_id=VYFTHQXTBRBEUST4WDKFIWQNUTYA7CG4QNFPMOT6DODXJNZ2VM4A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.376249297 (94h59m52.179608475s) [noise=true , address=185.167.204.206:4059 , piece_id=KWDCUQPHLV3JS5EX53IRUOWXBUYIMTRBN2O3HQB2PJSGD23DIC7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.378520011 (94h59m52.181879189s) [noise=true , address=185.167.204.206:4065 , piece_id=2CVZHBMCSCAXELY2KCT2NZM4D62MVX4XUZYJ5KN5Y7TIPWBFNLZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.399363622 (94h59m52.202722797s) [noise=true , address=185.167.204.206:4040 , piece_id=OP62LSZB5NTZRLPVNDZ43NAZBNUWTSNDQJ6VJDJL6DUFVPRI2IHA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.406768736 (94h59m52.210127911s) [noise=true , address=185.167.204.205:4024 , piece_id=RW5DLCHTL2YYXXACPMIOL4F272EOA3RWFS4RXNNG6C3HQKK4UQ7Q, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.417636285 (94h59m52.22099546s) [noise=true , address=185.167.204.206:4056 , piece_id=A2AWXBQRVBRASWKWQCPXF374K4LBPOMCSI4IB2XKS7Y2EF2TEANA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.615504670 (94h59m52.418863852s) [noise=true , address=185.167.204.206:4046 , piece_id=7765B3X3MLJOCQU7FH6SEACZPRWWR2VSAPHUBTVB7HIBJWREO7JQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:15:51.665309046 (94h59m52.468668221s) [noise=true , address=185.167.204.206:4058 , piece_id=HTIIXJBJAYVWUTHCAE3P3GJ36SACHYLQRUHH7JIGLZFRBAGMELQA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:13.755395871 (95h0m14.558755044s) [noise=true , address=89.149.201.147:4019 , piece_id=6EVJL36GVSGTOTI5TLWQWHR3RFAKWOTIM3KDXPSERT5E32LLJBZA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:21.073112560 (95h0m21.876471738s) [noise=true , address=89.149.201.147:4013 , piece_id=5WZ4JLQQWUOXZZHRCUHYYNWTXDQ4CP7FRMNSFVFGCSIHDYUIQM6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:29.098310211 (95h0m29.901669375s) [noise=true , address=89.149.201.147:4022 , piece_id=ZNBJRLKJCYRQKWB23KSBGNGQHUQWIVY2S3IHLAWYXJUL4YP4NTRQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:32.838317023 (95h0m33.6416762s) [noise=true , address=89.149.201.147:4003 , piece_id=ZPK3ST6K27NY4BUWKTX2R5IJXAZKIGYK6KZTU2ZBDEUBA4IRBS6A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.061309853 (95h0m41.864669028s) [noise=true , address=89.149.201.147:4004 , piece_id=3IESG5PLKB5MD43ZDEH7VRFSI3XCMQYJFEQXGJUVKVD7YWLSSBWA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:41.491479461 (95h0m42.29483863s) [noise=true , address=89.149.201.147:4007 , piece_id=Y22ZNDIMKAHWTQR7XOTD2UUPFOGJHTMHR6LFZIEG3PAG3T7WKZOA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:42.762937700 (95h0m43.566296879s) [noise=true , address=81.171.14.70:4037 , piece_id=ZPMQAXVGPCVB7JGKYUHSDYQ42EQMGVW6WJQFOYGCH6EXWB4KQKPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.156926452 (95h0m46.960285617s) [noise=true , address=89.149.201.147:4023 , piece_id=OJH7DWLP4XFSVWYENJB3R22V3QFCM5Z36TSL6UQACYJD33Y3CKDA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.315799322 (95h0m47.119158502s) [noise=true , address=81.171.14.70:4035 , piece_id=G5WJSO4K4PQ73LZFRGBZIGSPCHXNWL35X6C6PBN4NCOMV22LTVYA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:46.586850374 (95h0m47.390209557s) [noise=true , address=81.171.14.70:4042 , piece_id=J2TDEJMQKFGLWIMIO2CCZBVKIU44H7QQE75433JGMRVNKWYXPICQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:48.351650522 (95h0m49.155009708s) [noise=true , address=81.171.14.70:4047 , piece_id=4KYAQU33WGVRW7IT4B5D6RG7I4ZKZIYFTUK4RUCHJ4ZJZCCURPZQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:49.557948872 (95h0m50.361308067s) [noise=true , address=81.171.14.70:4028 , piece_id=7PCZEMODUBLNXB7NEDHOBPN6YTKXIL3V4RDT4LE3F5KLOWUIQPPQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: <nil>
Feb 21 19:16:50.299265034 (95h0m51.102624217s) [noise=true , address=81.171.14.70:4041 , piece_id=BQXOPBYNKU65ZIOQRVYHISJDYFC4K6DK5ADLRTSJMQ2AZ2SFFPKQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12U7CWC6tPDsNkmYf6uyKgFjwvYaUwUte6dmzUsZQPzm7ecPsLC, address:81.171.14.70:4041): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299356046 (95h0m51.102715231s) [noise=true , address=81.171.14.70:4040 , piece_id=Z7B2APB4MVDCLW4FOMUSFSSWSDZW6JSUFH2ATD53RG6TEIZ3IZJQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, address:81.171.14.70:4040): protocol: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56700->81.171.14.70:4040: use of closed network connection
Feb 21 19:16:50.299572314 (95h0m51.102931497s) [noise=true , address=89.149.201.147:4015 , piece_id=H4CU773EPMFJHIBVAPCNCYP6465HSO7GDMGPQOLE6F6HBJMF3OHQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299586999 (95h0m51.102946177s) [noise=true , address=89.149.201.147:4018 , piece_id=M2C5FCNQX5OMLW4QAA23E2QUGQ5YMTR55CLMGXDUCIRULC6QKKFA, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:53190->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 19:16:50.299755289 (95h0m51.103114478s) [noise=true , address=81.171.14.70:4045 , piece_id=O3XOXU7OAH5CXFYSOKZRSOPE3G4D5IVHMECMIWESSBV6QRMODM3A, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: expected piece hash; context deadline exceeded; EOF
Feb 21 19:16:50.299941094 (95h0m51.103300275s) [noise=true , address=81.171.14.70:4025 , piece_id=LJD3YDSLZDF74J23PN4HEZWBO7ZMY5MNLQPIP6OELKTUBBFJ57VQ, seg_pos={0 0}, upload=99019]: Done uploading piece. err: ecclient: upload failed (node:1ruq1atBi7bkJYK7Kqv63js28sW75imA1SwTytzLneZqRRSGFU, address:81.171.14.70:4025): protocol: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46018->81.171.14.70:4025: use of closed network connection
Feb 21 19:16:50.300005871 (95h0m51.10336505s) [seg_pos={0 0}, upload=99019]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil>
Feb 21 19:16:50.409954561 (95h0m51.213313743s) [upload=99019]: Done uploading segments...
Feb 21 19:16:50.410000665 (95h0m51.213359855s) [upload=99019]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22)
Duration: 12.287575012s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.773748ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1896590DC4D82794 X-Request-Id=9egWV9d6YJh X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:16:59 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/65fae222f7926413
FAIL (2026-02-21 19:16:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896590DC4D82794</RequestId><HostId></HostId></Error>"
Duration: 9.79856ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.370286ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:16:58 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes X-Amz-Request-Id=1896590DA5B52F81 X-Request-Id=6tTjmJphzHB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1d90df9cfe166ae2
FAIL (2026-02-21 19:16:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896590DA5B52F81</RequestId><HostId></HostId></Error>"
Duration: 11.395553ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.372702ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1896590D3EE5618E X-Request-Id=Y8bGJCYUhaD X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 19:16:56 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4dbd8817d088d72f
FAIL (2026-02-21 19:16:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896590D3EE5618E</RequestId><HostId></HostId></Error>"
Duration: 11.465603ms
edge
gateway
vhost
bgp
ap1
|