Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.260673ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Request-Id=JqUpReL7yGQ X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:44:46 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C8AA0B293B93 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5e89f994cedcfabc
FAIL (2026-03-01 17:44:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8AA0B293B93</RequestId><HostId></HostId></Error>"
Duration: 10.281147ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.242202ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C8A9E6CEAA06 X-Request-Id=FQoSTzV6LpT Content-Length=284 Server=Storj X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:44:45 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2f36f8d304049660
FAIL (2026-03-01 17:44:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8A9E6CEAA06</RequestId><HostId></HostId></Error>"
Duration: 30.265308ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.516181ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898C8A775BCA43C X-Request-Id=cK937vsHB4b X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:44:34 GMT Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/46608211a80d6fcf
FAIL (2026-03-01 17:44:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8A775BCA43C</RequestId><HostId></HostId></Error>"
Duration: 11.614565ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.65276ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8A3F651EB3D Date=Sun, 01 Mar 2026 17:44:19 GMT X-Request-Id=YVua9v27Pps X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6efa2793364f9696
FAIL (2026-03-01 17:44:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8A3F651EB3D</RequestId><HostId></HostId></Error>"
Duration: 12.674022ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.467838ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=YpobfYHdPMZ X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:43:53 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C89DEA9A3FC5 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6342beb45a07085
FAIL (2026-03-01 17:43:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C89DEA9A3FC5</RequestId><HostId></HostId></Error>"
Duration: 28.494677ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.119132238s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:43:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.119148162s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.584465ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898C89ABE7A4F72 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=b1gVgYAN6x4 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:43:40 GMT Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5a8d1de1db422f65
FAIL (2026-03-01 17:43:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C89ABE7A4F72</RequestId><HostId></HostId></Error>"
Duration: 13.604822ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.931247ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Content-Length=274 X-Amz-Request-Id=1898C899950AC4B7 X-Request-Id=3U1PnP9QQJ4 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:43:35 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5afb2b3b259d8a55
FAIL (2026-03-01 17:43:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C899950AC4B7</RequestId><HostId></HostId></Error>"
Duration: 8.951673ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.969731ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1898C898A36FBE1F X-Request-Id=ER5C46rP5EW X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:43:31 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/43b413383ff6b15f
FAIL (2026-03-01 17:43:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C898A36FBE1F</RequestId><HostId></HostId></Error>"
Duration: 12.990676ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.871942ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C893B2D3481C Date=Sun, 01 Mar 2026 17:43:10 GMT Server=Storj X-Request-Id=9LWrzxfsVAq X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/9ca53319635eab4
FAIL (2026-03-01 17:43:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C893B2D3481C</RequestId><HostId></HostId></Error>"
Duration: 10.897331ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.566629247s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:43:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.566661852s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.08433ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1898C88D882B92DD X-Request-Id=8gdit847MzJ Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:42:43 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/46d7d141a9697b9c
FAIL (2026-03-01 17:42:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C88D882B92DD</RequestId><HostId></HostId></Error>"
Duration: 31.102432ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.245128ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Date=Sun, 01 Mar 2026 17:42:43 GMT Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C88DA19B9DBA X-Request-Id=SR4LNYHnRzq X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/42e5963fff080160
FAIL (2026-03-01 17:42:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C88DA19B9DBA</RequestId><HostId></HostId></Error>"
Duration: 11.259119ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.698499ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C88CC9BB97DF X-Request-Id=GGwmpJYLLLv X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 17:42:40 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/14c6680885eafdee
FAIL (2026-03-01 17:42:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C88CC9BB97DF</RequestId><HostId></HostId></Error>"
Duration: 14.720696ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.5236159s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:42:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.523708232s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.20695ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:41:57 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=1898C882B33C18BB X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=4bqxoo9wf5p target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7056493d05f10247
FAIL (2026-03-01 17:41:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C882B33C18BB</RequestId><HostId></HostId></Error>"
Duration: 10.22621ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.990825ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C87E6780F974 X-Request-Id=dDpMJJJS538 Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:41:38 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1c18fd20a2429bd9
FAIL (2026-03-01 17:41:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C87E6780F974</RequestId><HostId></HostId></Error>"
Duration: 10.014865ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.874606ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C87E124D7530 X-Request-Id=HPN6ogvNuVR X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:41:37 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2aeba71f0a65d0dd
FAIL (2026-03-01 17:41:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C87E124D7530</RequestId><HostId></HostId></Error>"
Duration: 13.916524ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.945291ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=2WUbmqRAnJq X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:41:28 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C87C2AA0899E target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7eb139a5e254decc
FAIL (2026-03-01 17:41:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C87C2AA0899E</RequestId><HostId></HostId></Error>"
Duration: 28.964556ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.588079ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Vary=Origin X-Amz-Request-Id=1898C8795ED1C0C9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=Le2MBCZY8A2 Date=Sun, 01 Mar 2026 17:41:16 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/25498419e5c24835
FAIL (2026-03-01 17:41:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8795ED1C0C9</RequestId><HostId></HostId></Error>"
Duration: 8.610788ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.969545ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=aUqyh2pfYMp X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:41:14 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898C878E063A7A9 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/53fc11c11c91fc98
FAIL (2026-03-01 17:41:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C878E063A7A9</RequestId><HostId></HostId></Error>"
Duration: 10.993592ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.102503183s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:41:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.102528534s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.281232ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8762B8A29F7 X-Request-Id=QEEC6EkkcYA Date=Sun, 01 Mar 2026 17:41:03 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1f54f995a8b6bd10
FAIL (2026-03-01 17:41:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8762B8A29F7</RequestId><HostId></HostId></Error>"
Duration: 29.308299ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.980377ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C87322445A8A X-Request-Id=fsN4xtWmXV7 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:40:50 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1b20d22e513540d6
FAIL (2026-03-01 17:40:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C87322445A8A</RequestId><HostId></HostId></Error>"
Duration: 12.0015ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.521643ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=35oTDipKNDY Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C871C4E8B318 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:40:44 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/641670d1d6aa947d
FAIL (2026-03-01 17:40:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C871C4E8B318</RequestId><HostId></HostId></Error>"
Duration: 27.564133ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
20.623161ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:40:34 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C86F7E89BDAC X-Request-Id=j64X6je8bcE X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/28919fc4bab714ea
FAIL (2026-03-01 17:40:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C86F7E89BDAC</RequestId><HostId></HostId></Error>"
Duration: 20.63907ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.550959693s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:40:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.550988133s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.285328ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C86D61548FD0 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=7ejGGuZrsYP Date=Sun, 01 Mar 2026 17:40:25 GMT Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6bfe7b2c4a88522
FAIL (2026-03-01 17:40:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C86D61548FD0</RequestId><HostId></HostId></Error>"
Duration: 28.307938ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.120947225s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:40:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.120970718s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.729688ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:40:01 GMT Content-Type=application/xml X-Amz-Request-Id=1898C867C6A7FF53 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=LbUtj3EcnSD target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1a5a188841ffe751
FAIL (2026-03-01 17:40:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C867C6A7FF53</RequestId><HostId></HostId></Error>"
Duration: 10.753741ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.469167ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Server=Storj X-Amz-Request-Id=1898C864820F2EFF X-Request-Id=SqejTeDYSAz Date=Sun, 01 Mar 2026 17:39:47 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3b0aec22deb7c49d
FAIL (2026-03-01 17:39:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C864820F2EFF</RequestId><HostId></HostId></Error>"
Duration: 10.489893ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.512372715s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:39:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.512400085s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.191897ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1898C8627EEF7B58 Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=SCwY4mrQsoU X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:39:38 GMT Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/50e40887f73c9126
FAIL (2026-03-01 17:39:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8627EEF7B58</RequestId><HostId></HostId></Error>"
Duration: 29.21882ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.960092ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=WXN5BvE38GB X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898C861202EDCA7 Date=Sun, 01 Mar 2026 17:39:32 GMT Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5234756182c09e0c
FAIL (2026-03-01 17:39:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C861202EDCA7</RequestId><HostId></HostId></Error>"
Duration: 15.995935ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.608805ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:39:10 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C85BD7F74F6B X-Request-Id=4RcP5zQ9cTR target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2439a4cb75259d11
FAIL (2026-03-01 17:39:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C85BD7F74F6B</RequestId><HostId></HostId></Error>"
Duration: 10.630679ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.55080167s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:39:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.550828667s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.734114ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=2AyFt4aoEX9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C858817B0455 Date=Sun, 01 Mar 2026 17:38:55 GMT Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7384c7a1ababd7c5
FAIL (2026-03-01 17:38:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C858817B0455</RequestId><HostId></HostId></Error>"
Duration: 10.755481ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.179817ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C85713C64474 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:38:49 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=DhMy5PWwt3F target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/a85975b476b59bb
FAIL (2026-03-01 17:38:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C85713C64474</RequestId><HostId></HostId></Error>"
Duration: 29.200194ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.67892ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C85653AE15CF Content-Length=274 Content-Type=application/xml X-Request-Id=NUzPTFDs7Xn X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:38:46 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/19584159af8e8ebf
FAIL (2026-03-01 17:38:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C85653AE15CF</RequestId><HostId></HostId></Error>"
Duration: 12.702001ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.653664ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=HM9t5j7kthD Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C85432F9885E X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:38:37 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/556d20811bfd490
FAIL (2026-03-01 17:38:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C85432F9885E</RequestId><HostId></HostId></Error>"
Duration: 9.671625ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.760624487s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:38:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.760710232s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.339208ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C84B7FD5068F X-Request-Id=DFZq7xmhT8B X-Xss-Protection=1; mode=block Content-Type=application/xml Date=Sun, 01 Mar 2026 17:37:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/27014f1984cc6741
FAIL (2026-03-01 17:37:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C84B7FD5068F</RequestId><HostId></HostId></Error>"
Duration: 14.362359ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.11913ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:37:40 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C846DF7B7CFA X-Request-Id=3NL25WHAvEM target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/37c8407aa16e5a9c
FAIL (2026-03-01 17:37:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C846DF7B7CFA</RequestId><HostId></HostId></Error>"
Duration: 10.141606ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.064269ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C84643D154D8 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=5q5nLY6AYva Date=Sun, 01 Mar 2026 17:37:37 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/300064c68674121f
FAIL (2026-03-01 17:37:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C84643D154D8</RequestId><HostId></HostId></Error>"
Duration: 9.088667ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.527695ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Vary=Origin X-Request-Id=fQUsFyZeXtG X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898C845BE225318 Date=Sun, 01 Mar 2026 17:37:35 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/df9d3f9b99b7f61
FAIL (2026-03-01 17:37:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C845BE225318</RequestId><HostId></HostId></Error>"
Duration: 30.556248ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.421029ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C8444AA0DEBC X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=DAvNDSLspri Date=Sun, 01 Mar 2026 17:37:29 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/33087cf5bdf383eb
FAIL (2026-03-01 17:37:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8444AA0DEBC</RequestId><HostId></HostId></Error>"
Duration: 10.443875ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.009824ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1898C83ED06E2846 X-Request-Id=Zxcis1F6SC4 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:37:05 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5eaa3aa683b51c7d
FAIL (2026-03-01 17:37:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C83ED06E2846</RequestId><HostId></HostId></Error>"
Duration: 12.031593ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.58565553s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:36:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.585673985s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.830015ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes X-Request-Id=Mja1okKUZeS X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:36:49 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C83AFD51285B target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6e180766db4458ed
FAIL (2026-03-01 17:36:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C83AFD51285B</RequestId><HostId></HostId></Error>"
Duration: 9.913485ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.724083ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=h7jTMja6YvM X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C839AC924983 Date=Sun, 01 Mar 2026 17:36:43 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/454066477792873
FAIL (2026-03-01 17:36:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C839AC924983</RequestId><HostId></HostId></Error>"
Duration: 10.747132ms
edge
gateway
vhost
bgp
us1
|