Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.537683ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=GSWrEuhTkRB X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:26:36 GMT Content-Length=274 X-Amz-Request-Id=1896564DF422EB27 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/479aa66d2eac18e3
FAIL (2026-02-21 18:26:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896564DF422EB27</RequestId><HostId></HostId></Error>"
Duration: 15.563052ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.738194ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Date=Sat, 21 Feb 2026 18:26:11 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896564827F630EA X-Request-Id=8uRxy3FmemJ X-Xss-Protection=1; mode=block Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/394ae0c518f39451
FAIL (2026-02-21 18:26:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896564827F630EA</RequestId><HostId></HostId></Error>"
Duration: 27.754121ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.86057ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=EiA8B9sf7mH X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18965647715D066C Date=Sat, 21 Feb 2026 18:26:08 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/d5e7ee76c834fbb
FAIL (2026-02-21 18:26:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965647715D066C</RequestId><HostId></HostId></Error>"
Duration: 11.880851ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.907608ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896564459A2D8C1 X-Request-Id=2jfDfGRbNKY Date=Sat, 21 Feb 2026 18:25:54 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/413fd1e1d8fe8949
FAIL (2026-02-21 18:25:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896564459A2D8C1</RequestId><HostId></HostId></Error>"
Duration: 10.929507ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.078721339s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:25:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.078747622s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.342639ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1896564112441272 X-Xss-Protection=1; mode=block Content-Length=274 X-Request-Id=9WaPWfDxahu Date=Sat, 21 Feb 2026 18:25:40 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/237c7a164da3df3
FAIL (2026-02-21 18:25:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896564112441272</RequestId><HostId></HostId></Error>"
Duration: 10.368408ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.284978ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896563F334AEF2B X-Request-Id=Dj2HxCVwAN5 Date=Sat, 21 Feb 2026 18:25:32 GMT Content-Length=274 Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2d8fd59a4bc27e0d
FAIL (2026-02-21 18:25:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896563F334AEF2B</RequestId><HostId></HostId></Error>"
Duration: 11.304374ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.421363ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:25:30 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896563E901CF7DF X-Request-Id=BWf5MnnLxak Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3c1473fd38450596
FAIL (2026-02-21 18:25:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896563E901CF7DF</RequestId><HostId></HostId></Error>"
Duration: 21.463823ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
38.630152ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=1896563830C72BBE X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=D6ArKz6tE1f Date=Sat, 21 Feb 2026 18:25:02 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7b60dd9ce6a600d8
FAIL (2026-02-21 18:25:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896563830C72BBE</RequestId><HostId></HostId></Error>"
Duration: 38.658852ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.738575ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes X-Amz-Request-Id=18965633B162BE99 X-Request-Id=AB1vhNyScU3 Date=Sat, 21 Feb 2026 18:24:43 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2f0fcad60973e55d
FAIL (2026-02-21 18:24:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965633B162BE99</RequestId><HostId></HostId></Error>"
Duration: 11.762708ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.848858ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sat, 21 Feb 2026 18:24:33 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189656316975DCD2 X-Request-Id=g9echpDwXGz X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/402923b63e7ddb35
FAIL (2026-02-21 18:24:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189656316975DCD2</RequestId><HostId></HostId></Error>"
Duration: 11.87219ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.26548ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=U2rNGJrReD4 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:24:32 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896563134D5F3BD target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5e8729393fce4c2f
FAIL (2026-02-21 18:24:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896563134D5F3BD</RequestId><HostId></HostId></Error>"
Duration: 30.352518ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.116666729s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:24:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.116703434s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.916212ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=189656304BDDAB16 X-Request-Id=HGA3bGx9R9E X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:24:28 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/57e2a4f60b47641d
FAIL (2026-02-21 18:24:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189656304BDDAB16</RequestId><HostId></HostId></Error>"
Duration: 13.935405ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.963728ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=baC3hPxDE81 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:24:13 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896562CD5069155 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4b299470cafa4371
FAIL (2026-02-21 18:24:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896562CD5069155</RequestId><HostId></HostId></Error>"
Duration: 11.98983ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.027192ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin Date=Sat, 21 Feb 2026 18:23:40 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1896562516D7D156 X-Request-Id=b3Romb9RdoX X-Xss-Protection=1; mode=block Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/65c17fe5bf249320
FAIL (2026-02-21 18:23:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896562516D7D156</RequestId><HostId></HostId></Error>"
Duration: 31.050355ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.292828ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1896562514C455E8 X-Request-Id=NCf8rVzvho5 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:23:40 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6d2ad4e4f3362da2
FAIL (2026-02-21 18:23:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896562514C455E8</RequestId><HostId></HostId></Error>"
Duration: 14.315308ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.143365311s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:23:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.143389669s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.646566ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=9SwG3mFoD7f X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896561FFA51C9CA Date=Sat, 21 Feb 2026 18:23:18 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1f6cbaf550b75945
FAIL (2026-02-21 18:23:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896561FFA51C9CA</RequestId><HostId></HostId></Error>"
Duration: 10.668303ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.594854ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1896561EA9EA6F83 X-Request-Id=LQxsUHsXKwW X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:23:13 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/317d3d20bf4fc23
FAIL (2026-02-21 18:23:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896561EA9EA6F83</RequestId><HostId></HostId></Error>"
Duration: 11.614745ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.842214ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=LEHDT9EemYK Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1896561B6C6AE0A3 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:22:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/129a778f6b938e14
FAIL (2026-02-21 18:22:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896561B6C6AE0A3</RequestId><HostId></HostId></Error>"
Duration: 10.865325ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.210445687s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:22:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.210579159s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.535649ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=88zzMQ7Ebn9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1896561816FBFFCE Date=Sat, 21 Feb 2026 18:22:44 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3fca329bcd31e088
FAIL (2026-02-21 18:22:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896561816FBFFCE</RequestId><HostId></HostId></Error>"
Duration: 10.555604ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.585821ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189656178169213E X-Request-Id=MU1Wiq49XWi X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Date=Sat, 21 Feb 2026 18:22:42 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3bc77c80b78865cc
FAIL (2026-02-21 18:22:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189656178169213E</RequestId><HostId></HostId></Error>"
Duration: 13.677243ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.445919ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:22:41 GMT Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Request-Id=HtHYKQY5aCC Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189656175AD91E1A target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/c747bbeecb00171
FAIL (2026-02-21 18:22:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189656175AD91E1A</RequestId><HostId></HostId></Error>"
Duration: 30.468739ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.494827723s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:22:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.494860286s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.506573214s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:22:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.50661428s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.296128ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18965612230F09DE X-Request-Id=TYyDjwbwguL Date=Sat, 21 Feb 2026 18:22:19 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/16e09894b3a46531
FAIL (2026-02-21 18:22:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965612230F09DE</RequestId><HostId></HostId></Error>"
Duration: 12.319605ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.168729ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 X-Amz-Request-Id=18965611A452B84D X-Request-Id=Nsvh88EFYnr Date=Sat, 21 Feb 2026 18:22:17 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1d5fcac174d3f742
FAIL (2026-02-21 18:22:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18965611A452B84D</RequestId><HostId></HostId></Error>"
Duration: 29.181241ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.553685ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896560BD02560F3 X-Request-Id=ASxnPNWwFWU Date=Sat, 21 Feb 2026 18:21:52 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/31fc5cd5020eb8dd
FAIL (2026-02-21 18:21:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896560BD02560F3</RequestId><HostId></HostId></Error>"
Duration: 13.576549ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.501187006s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:21:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.501213086s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.929308ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=1896560B34B96403 X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:21:49 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=XEdQBddmnZL target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2df9a6b9ec653e21
FAIL (2026-02-21 18:21:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896560B34B96403</RequestId><HostId></HostId></Error>"
Duration: 11.956245ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.721269ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1896560979C7687E X-Request-Id=JwjhnePEAQT Date=Sat, 21 Feb 2026 18:21:42 GMT Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/779ae338cc8e99b3
FAIL (2026-02-21 18:21:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896560979C7687E</RequestId><HostId></HostId></Error>"
Duration: 18.738599ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.130387571s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:21:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.13041374s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.123619ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:21:20 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1896560486023298 X-Request-Id=ewgChPfwaKd target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6c5791a38b1cdbef
FAIL (2026-02-21 18:21:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896560486023298</RequestId><HostId></HostId></Error>"
Duration: 27.146606ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.687345ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=ewzZcRhTd5b Content-Length=274 X-Amz-Request-Id=1896560141121EDE X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:21:06 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/446cf16bec80be8b
FAIL (2026-02-21 18:21:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1896560141121EDE</RequestId><HostId></HostId></Error>"
Duration: 16.710334ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.22642ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:20:55 GMT Accept-Ranges=bytes Content-Length=284 X-Amz-Request-Id=189655FE87C9F6D0 X-Request-Id=eZ8XeJ5y8ZZ Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4cd44bc593ae6375
FAIL (2026-02-21 18:20:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655FE87C9F6D0</RequestId><HostId></HostId></Error>"
Duration: 29.253548ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.611528ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=189655FC3384CB6E Date=Sat, 21 Feb 2026 18:20:45 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=VmTHssp6JDv X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/495d31c809fe4330
FAIL (2026-02-21 18:20:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655FC3384CB6E</RequestId><HostId></HostId></Error>"
Duration: 9.631752ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.076125658s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:20:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.076150807s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.927404ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189655F98359BC60 X-Request-Id=AETCcbZKW7i X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Sat, 21 Feb 2026 18:20:33 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5746dcfdbcf202a
FAIL (2026-02-21 18:20:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655F98359BC60</RequestId><HostId></HostId></Error>"
Duration: 10.947528ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.33697016s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:20:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.336997473s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.193625825s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:20:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 2.193667653s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.008611977s trace:
https://jaeger.dev.storj.io/trace/3b805f6c58da7568
FAIL (2026-02-21 18:20:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, Piece ID: O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA) context deadline exceeded; piecestore: (Node ID: 1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, Piece ID: JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA) context deadline exceeded; piecestore: (Node ID: 12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, Piece ID: NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ) context deadline exceeded; piecestore: (Node ID: 12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, Piece ID: UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA) context deadline exceeded; piecestore: (Node ID: 1gannW154cmVP6N5BowytKfDorZDRwx2M5pi6akqjZFU38PGjV, Piece ID: 6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ) context deadline exceeded; piecestore: (Node ID: 12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, Piece ID: IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA) context deadline exceeded; piecestore: (Node ID: 12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, Piece ID: 63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ) context deadline exceeded; piecestore: (Node ID: 12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, Piece ID: AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ) context deadline exceeded; piecestore: (Node ID: 1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, Piece ID: PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA) context deadline exceeded; piecestore: (Node ID: 1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, Piece ID: IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ) context deadline exceeded; piecestore: (Node ID: 14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, Piece ID: XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ) context deadline exceeded; piecestore: (Node ID: 1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, Piece ID: XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ) context deadline exceeded; piecestore: (Node ID: 122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, Piece ID: EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ) context deadline exceeded; piecestore: (Node ID: 1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, Piece ID: OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ) context deadline exceeded; piecestore: (Node ID: 12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, Piece ID: SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA) context deadline exceeded; piecestore: (Node ID: 122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, Piece ID: 5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ) context deadline exceeded; piecestore: (Node ID: 12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, Piece ID: KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ) context deadline exceeded
======LOGS======
_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534076578 (94h3m6.337435764s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.534639827 (94h3m6.33799901s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535341709 (94h3m6.33870089s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.535822329 (94h3m6.339181508s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.536415937 (94h3m6.33977512s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537097150 (94h3m6.340456335s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.537732718 (94h3m6.341091904s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540180234 (94h3m6.343539409s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:05.540802610 (94h3m6.344161795s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Uploading piece...
Feb 21 18:19:06.006518024 (94h3m6.809877226s) [upload=98029]: Next returned nil segment
Feb 21 18:19:06.006530197 (94h3m6.809889397s) [upload=98029]: Waiting for error group managing segments...
Feb 21 18:19:06.185627760 (94h3m6.988986942s) [noise=true , address=185.167.204.205:4009 , piece_id=UB4OZ3DGXTQ237YSQJYPU3ABQNGMB5RGREAMOQGO2HYAD25X5YLQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.189664650 (94h3m6.993023824s) [noise=true , address=185.167.204.206:4060 , piece_id=6ODWRQMTVXBQBSMPTKLAT5FSOKIOADU2CVJ4WB5DFZIQMFUNVP5Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.193570017 (94h3m6.996929199s) [noise=true , address=185.167.204.206:4051 , piece_id=HXBJOJZDW2SUAYRLJVMGRUL2RTV6VH4KXKW3DVJU5RTDAYUREDTA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.196954514 (94h3m7.000313702s) [noise=true , address=185.167.204.206:4052 , piece_id=6JZVHQ3PE3ZTDZAQRCZ2CZAVPYW2FTTMZ635C3FCKH6N7HZ67QNQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.198632860 (94h3m7.001992041s) [noise=true , address=185.167.204.205:4034 , piece_id=PX25SBROYGSU5BDTYWO3F4JIHQLVOYPN4QY7HYQEYGBL5YRDBOQA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.203408790 (94h3m7.006767969s) [noise=true , address=185.167.204.205:4020 , piece_id=UF63KL2KKFVQLUSKQK3MV4UX5JPBXV5U3UISV7BOVADQ6P5F6HGA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.205963562 (94h3m7.009322743s) [noise=true , address=185.167.204.205:4002 , piece_id=5PQKWFMAAVFDYXJZREVJNJCBHP4S5KSIHI2CAMODYEB3N6XPOAHQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.227108576 (94h3m7.030467753s) [noise=true , address=185.167.204.205:4028 , piece_id=O6YWH3SIF2NQJAE5C4OZTDM74WFSNFGVCPO5CGDMGUONRGVIOGRA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.244394217 (94h3m7.047753395s) [noise=true , address=185.167.204.206:4037 , piece_id=63KSJP6HI5L3Y6XOSDYZWBVPEPKPFOR23DYBX3I3WHCLSGNPAQVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.248422832 (94h3m7.051782061s) [noise=true , address=185.167.204.206:4038 , piece_id=U7AS7YPGA57ANDJWMSL5KTR5SHIBD7754JI7MTLGGXOOI6KA4UEA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.257863373 (94h3m7.061222547s) [noise=true , address=185.167.204.205:4036 , piece_id=NY4SUBYEGXCVC4CUCJDNUJ3PSTDXU35JFZJS5NPPUM3O3X42OHDQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:06.274327440 (94h3m7.077686614s) [noise=true , address=185.167.204.206:4062 , piece_id=AGSGMMPZ4SCCZW5NU227YQPTB6OBGILNNVDG3F2BEXHTTAH6DOVQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:08.340179835 (94h3m9.143539011s) [noise=true , address=89.149.201.147:4018 , piece_id=OB5HIWULEC52U7RTH23MK2ISEFROHI55NT4RQW5G35TEAW3H4LTQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:10.185110122 (94h3m10.988469297s) [noise=true , address=89.149.201.147:4024 , piece_id=KHALZS6J2X2HMQBVXIHPJNK63E4KETKT6K734LXG63CHH3LCPSMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:16.047118654 (94h3m16.850477837s) [noise=true , address=89.149.201.147:4003 , piece_id=ARB2W6IOUKXSP4WN2SGJXDCS4V52WHNALGFEPDFHIA2EX4ZEVE7Q, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:18.375852211 (94h3m19.179211385s) [noise=true , address=89.149.201.147:4004 , piece_id=KERXWQEPQV32UUEYJUJN2VPYQWL65Z3MYG7GTN7FC64SQLMSWKCA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:19.504783382 (94h3m20.308142559s) [noise=true , address=89.149.201.147:4008 , piece_id=JPFV2AZTOBWN25RW5N35UHUZU44DCIMC5CR463WPLNDYT3DYYNAA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:31.034441704 (94h3m31.837800879s) [noise=true , address=89.149.201.147:4007 , piece_id=XOPR34WHDEA27UR4BEVSK5WKDC2Z7LWMFQTCNYQOO4FGV7AJ3TOQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:47.035466134 (94h3m47.838825308s) [noise=true , address=89.149.201.147:4019 , piece_id=2WIEPRG4U4EGGDTBAHWEG4A3MLTLWEDYKJHPWUOMLLVXAZVUMBJQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.625059110 (94h4m0.428418288s) [noise=true , address=81.171.14.70:4037 , piece_id=IYXPMSGIDPLCHZICR5BFG7AON47H7VUHSBHAS52Q2QIF4RCH4RKQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:19:59.937149119 (94h4m0.740508311s) [noise=true , address=81.171.14.70:4028 , piece_id=IQKJIKVOCHP6NX4DFICFRI2H4NTMFYQA65WKVFUYZ5HD7SXYEVMA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:01.312512094 (94h4m2.115871274s) [noise=true , address=81.171.14.70:4039 , piece_id=DUYHTNWQIARB7J3G5ZJSI6GL3DN3C33LTSDAO7QM3A2AXMI7CBPA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.126128999 (94h4m3.929488181s) [noise=true , address=81.171.14.70:4027 , piece_id=EF5ZBFNTSJ5GKP5FFZMYP6JNA3MCE5WJYFQJEL3MNFK3V6E2VJMQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.424284357 (94h4m4.227643522s) [noise=true , address=81.171.14.70:4040 , piece_id=6DIHX546PMPSWWH5J7UMDWUHO6XRUY3FPT6FXYRGKE46GGGSUYAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:03.597001608 (94h4m4.400360796s) [noise=true , address=81.171.14.70:4043 , piece_id=SPXN55OZHKWJI7Z6EN2VCP3UV2XYEBLKIVUOB4GQHWXVGE4BVLVA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354705237 (94h4m5.158064401s) [noise=true , address=89.149.201.147:4005 , piece_id=XGMPDCFJ7M47GWHDDHRJLO2QDADKNP7YMXKA6LRAJW5FZL6MCUAQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: <nil>
Feb 21 18:20:04.354796975 (94h4m5.158156159s) [seg_pos={0 0}, upload=98029]: Satisfied cohort requirements after 26 pieces
Feb 21 18:20:04.355168509 (94h4m5.158527683s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG): protocol: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34262->81.171.14.70:4048: use of closed network connection
Feb 21 18:20:04.355183471 (94h4m5.158542656s) [noise=true , address=81.171.14.70:4048 , piece_id=MKES3NMTL7ZKHNMOAJROQXWS6I3QF2RVCXUXYXP36RKK4HUTA6IQ, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355885267 (94h4m5.159244473s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8): protocol: rpc: dial tcp 81.171.14.70:4033: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 21 18:20:04.355900626 (94h4m5.159259812s) [noise=true , address=81.171.14.70:4033 , piece_id=ULVHH4NTXWHM2PT4BXHJ6L5WRDKCOOVHVYCCUQ77LX42ILK7SCOA, seg_pos={0 0}, upload=98029]: Long tail cancellation due to optimal threshold
Feb 21 18:20:04.355934181 (94h4m5.159293357s) [seg_pos={0 0}, upload=98029]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 21 18:20:04.356053420 (94h4m5.159412601s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 21 18:20:04.356060580 (94h4m5.159419742s) [upload=98029]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 21 18:20:04.635207042 (94h4m5.438566222s) [upload=98029]: Done uploading segments...
Feb 21 18:20:04.635235842 (94h4m5.438595022s) [upload=98029]: Upload finished. err: <nil>
Duration: 1m0.00863371s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.547468ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=jJ7ET9RJ6pZ Date=Sat, 21 Feb 2026 18:20:03 GMT Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=189655F299DCDEED X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4098cf3e012f4aae
FAIL (2026-02-21 18:20:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655F299DCDEED</RequestId><HostId></HostId></Error>"
Duration: 14.604394ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.143475ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sat, 21 Feb 2026 18:20:01 GMT Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=189655F20B573B20 X-Request-Id=Cvp9nEkzRqi target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/70176b66fd68681
FAIL (2026-02-21 18:20:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655F20B573B20</RequestId><HostId></HostId></Error>"
Duration: 15.172951ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.627565ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189655F0C5829225 X-Request-Id=UpBMJ5jFenJ X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin Date=Sat, 21 Feb 2026 18:19:56 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6ef13213eddda619
FAIL (2026-02-21 18:19:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655F0C5829225</RequestId><HostId></HostId></Error>"
Duration: 29.650246ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.110165ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=FSL6mzhMt8f X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=189655EE54480E9D Date=Sat, 21 Feb 2026 18:19:45 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7ced9bc7e358d4a3
FAIL (2026-02-21 18:19:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655EE54480E9D</RequestId><HostId></HostId></Error>"
Duration: 10.132504ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.91847ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj X-Amz-Request-Id=189655EA6607B531 X-Request-Id=35qqp6rW6Rt X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Date=Sat, 21 Feb 2026 18:19:28 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/727f96080cb9c9ce
FAIL (2026-02-21 18:19:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655EA6607B531</RequestId><HostId></HostId></Error>"
Duration: 28.939875ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.347854ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=BaYsGoaZNNi Date=Sat, 21 Feb 2026 18:19:20 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189655E86D35AE67 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4d3f7bbfc689c3c5
FAIL (2026-02-21 18:19:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655E86D35AE67</RequestId><HostId></HostId></Error>"
Duration: 11.376726ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.498952ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=ZqFqYb3pkHM X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189655E77E697751 Date=Sat, 21 Feb 2026 18:19:16 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/799227a48b9c0cd0
FAIL (2026-02-21 18:19:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189655E77E697751</RequestId><HostId></HostId></Error>"
Duration: 9.522097ms
edge
gateway
vhost
bgp
eu1
|