Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.036969ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB1A7A570E79 Content-Security-Policy=block-all-mixed-content X-Request-Id=D6pHoTio6EB X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:29:27 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/19abea9687b717e7
FAIL (2026-03-01 18:29:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB1A7A570E79</RequestId><HostId></HostId></Error>"
Duration: 10.056925ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.059148ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CB187D6CFE85 X-Request-Id=Ts1GBfrCeoc Date=Sun, 01 Mar 2026 18:29:19 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/f19873545960a9b
FAIL (2026-03-01 18:29:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB187D6CFE85</RequestId><HostId></HostId></Error>"
Duration: 11.08115ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.125813216s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:29:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.125837077s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.035991ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=N3YnfJozYix X-Xss-Protection=1; mode=block Content-Type=application/xml X-Amz-Request-Id=1898CB1296F409C8 Date=Sun, 01 Mar 2026 18:28:54 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6a80aee4bd52b77b
FAIL (2026-03-01 18:28:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB1296F409C8</RequestId><HostId></HostId></Error>"
Duration: 11.059424ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.335025ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CB11F9888E28 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:28:51 GMT Accept-Ranges=bytes Server=Storj X-Request-Id=cC6eGzyeVW Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7f94fa8dd64cd194
FAIL (2026-03-01 18:28:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB11F9888E28</RequestId><HostId></HostId></Error>"
Duration: 12.356508ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.117991ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898CB0B90108236 Content-Type=application/xml X-Request-Id=DhkDdSLqeka X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:28:23 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/598f1b1488bcc592
FAIL (2026-03-01 18:28:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB0B90108236</RequestId><HostId></HostId></Error>"
Duration: 31.1547ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.047892ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 18:28:16 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=1898CB09BBB59383 Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=C7AFDHi7g7i X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6fcb1a1224f19518
FAIL (2026-03-01 18:28:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB09BBB59383</RequestId><HostId></HostId></Error>"
Duration: 9.089332ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.57069553s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:28:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.57073075s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.37817ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB06EC3462F4 X-Request-Id=5P8zqiwyLk6 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Sun, 01 Mar 2026 18:28:03 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4b2a7e6f6af4eb7d
FAIL (2026-03-01 18:28:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB06EC3462F4</RequestId><HostId></HostId></Error>"
Duration: 10.405659ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.699788ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=MGJF63wJDvK Date=Sun, 01 Mar 2026 18:27:55 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CB0503B2A75A X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/611415edeec1b886
FAIL (2026-03-01 18:27:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB0503B2A75A</RequestId><HostId></HostId></Error>"
Duration: 8.728839ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.079967ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1898CB049715707B X-Request-Id=8xy7s1Tmmy5 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:27:53 GMT Accept-Ranges=bytes Server=Storj Vary=Origin Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6c32156cbcdc2049
FAIL (2026-03-01 18:27:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB049715707B</RequestId><HostId></HostId></Error>"
Duration: 26.104102ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.010148ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1898CB00B87F7FF0 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=DWSeES5TGdP X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:27:37 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2a08c01c6c61b8a3
FAIL (2026-03-01 18:27:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB00B87F7FF0</RequestId><HostId></HostId></Error>"
Duration: 10.04983ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.49404444s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:27:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.494069638s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.070771ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CAFF79A01A50 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Request-Id=AFbj3WBsBcS Date=Sun, 01 Mar 2026 18:27:31 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1d919bfcd93499f5
FAIL (2026-03-01 18:27:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAFF79A01A50</RequestId><HostId></HostId></Error>"
Duration: 12.105167ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.157603ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Sun, 01 Mar 2026 18:27:29 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=YCZ38t2scaH X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CAFEF18526C7 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2c6445fb4157cef9
FAIL (2026-03-01 18:27:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAFEF18526C7</RequestId><HostId></HostId></Error>"
Duration: 30.182087ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.871588ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898CAF824485A69 X-Request-Id=8DiUU5MBo1B Accept-Ranges=bytes Server=Storj X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:27:00 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4ec86907ed43bc27
FAIL (2026-03-01 18:27:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAF824485A69</RequestId><HostId></HostId></Error>"
Duration: 9.893518ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.364346ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 18:26:59 GMT X-Amz-Request-Id=1898CAF7ECF10AD9 X-Request-Id=Q6rV55Fp878 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/180c1346ee59bd4a
FAIL (2026-03-01 18:26:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAF7ECF10AD9</RequestId><HostId></HostId></Error>"
Duration: 11.396191ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.947268ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898CAF2F8B04C45 Date=Sun, 01 Mar 2026 18:26:38 GMT Content-Type=application/xml Server=Storj X-Request-Id=Hd7eqFfjeVt X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4bdbf6b2e7b7a2ce
FAIL (2026-03-01 18:26:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAF2F8B04C45</RequestId><HostId></HostId></Error>"
Duration: 9.975922ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.252826142s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:26:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.252849025s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.653206ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CAF0F94B4F4C X-Request-Id=FRs7dY2ankq X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:26:29 GMT Content-Length=274 Content-Type=application/xml Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/127dd2c9c9f0369a
FAIL (2026-03-01 18:26:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAF0F94B4F4C</RequestId><HostId></HostId></Error>"
Duration: 14.67383ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.764025ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=6fQeMcGWyoC X-Xss-Protection=1; mode=block Content-Length=284 Server=Storj Date=Sun, 01 Mar 2026 18:26:28 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CAF0BAE3EE96 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/21507cc832136b9e
FAIL (2026-03-01 18:26:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAF0BAE3EE96</RequestId><HostId></HostId></Error>"
Duration: 26.787373ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.217033ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CAEB2D5D6A64 X-Request-Id=HznxtZgW8jK X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Date=Sun, 01 Mar 2026 18:26:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1b4f87e9da39c2a
FAIL (2026-03-01 18:26:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAEB2D5D6A64</RequestId><HostId></HostId></Error>"
Duration: 9.24145ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.60547ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898CAEB0C42268B X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:26:04 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=ifJvWEr3Ufn Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6bb68a0311c779a0
FAIL (2026-03-01 18:26:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAEB0C42268B</RequestId><HostId></HostId></Error>"
Duration: 10.630976ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.465474ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1898CAEA450DA0F9 X-Request-Id=dMbhNtaDRnz X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content Date=Sun, 01 Mar 2026 18:26:00 GMT Accept-Ranges=bytes Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7b3d89a40e2d6094
FAIL (2026-03-01 18:26:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAEA450DA0F9</RequestId><HostId></HostId></Error>"
Duration: 31.486967ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.50094564s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:25:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.500962726s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.897983ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CAE3DDEB7FA9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Request-Id=AHnGSKNrS5H Date=Sun, 01 Mar 2026 18:25:33 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/54c0e50a3cb34f9d
FAIL (2026-03-01 18:25:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAE3DDEB7FA9</RequestId><HostId></HostId></Error>"
Duration: 9.920481ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.496413ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml X-Request-Id=K24KwpcD7Vt Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898CAE396FFA4EB X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:25:32 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1fd4790a86c60c9f
FAIL (2026-03-01 18:25:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAE396FFA4EB</RequestId><HostId></HostId></Error>"
Duration: 30.518279ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.536266ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:25:32 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1898CAE3A2C2B31C X-Request-Id=HnVTd282SN7 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1efad1517f2c04ad
FAIL (2026-03-01 18:25:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAE3A2C2B31C</RequestId><HostId></HostId></Error>"
Duration: 13.728017ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.485260037s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:25:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.485365193s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.158608ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=H3aTGAbykMY Date=Sun, 01 Mar 2026 18:25:08 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CADE2B046B49 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/11f3b530c33e3686
FAIL (2026-03-01 18:25:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CADE2B046B49</RequestId><HostId></HostId></Error>"
Duration: 9.184736ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.630917ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:25:00 GMT Content-Type=application/xml Server=Storj X-Request-Id=64EnLwDg8DQ Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898CADC3267ADC8 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5339b68bcaba98ab
FAIL (2026-03-01 18:25:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CADC3267ADC8</RequestId><HostId></HostId></Error>"
Duration: 30.657287ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.196011ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=1898CADC24902184 X-Request-Id=9edMpRoVN12 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:25:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/79fbaef9de46ad18
FAIL (2026-03-01 18:25:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CADC24902184</RequestId><HostId></HostId></Error>"
Duration: 11.21268ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.229918ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CAD9E2842EED X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:24:50 GMT Vary=Origin X-Request-Id=8p3S6DG9Wbz target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/318498c90e74b4e0
FAIL (2026-03-01 18:24:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAD9E2842EED</RequestId><HostId></HostId></Error>"
Duration: 10.325057ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.002953ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898CAD8CCB765FA Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=b1HVXficgeu X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:24:45 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/87339b1f473359a
FAIL (2026-03-01 18:24:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAD8CCB765FA</RequestId><HostId></HostId></Error>"
Duration: 15.0263ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.693216ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CAD0F36D5CB5 X-Request-Id=GfvbZBr7N4g Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:24:12 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/68a738912600b832
FAIL (2026-03-01 18:24:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAD0F36D5CB5</RequestId><HostId></HostId></Error>"
Duration: 9.73388ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.109825252s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:24:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.109895619s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.544230899s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:23:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.544255683s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.286755ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1898CACC84641EE7 X-Xss-Protection=1; mode=block X-Request-Id=LzXcw3Kpqeq Date=Sun, 01 Mar 2026 18:23:53 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/31e59277827a10c8
FAIL (2026-03-01 18:23:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CACC84641EE7</RequestId><HostId></HostId></Error>"
Duration: 12.297596ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.982401ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CACB58369339 X-Request-Id=RBtXTG9poq5 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:23:48 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4d1a899875bb0ef8
FAIL (2026-03-01 18:23:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CACB58369339</RequestId><HostId></HostId></Error>"
Duration: 13.004772ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.499986ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898CACAC24D0F7A Content-Length=284 Content-Type=application/xml Vary=Origin X-Request-Id=aRgSgXdF6ro X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:23:45 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/157bd45735a85e24
FAIL (2026-03-01 18:23:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CACAC24D0F7A</RequestId><HostId></HostId></Error>"
Duration: 29.514055ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.161304ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CAC3828484B2 X-Request-Id=3bXkPvXJx3y X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:23:14 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/10026ad7194e2cf6
FAIL (2026-03-01 18:23:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAC3828484B2</RequestId><HostId></HostId></Error>"
Duration: 33.181421ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.560538ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=RFU3jtps6tJ X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CAC2A4670A68 Date=Sun, 01 Mar 2026 18:23:10 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/ca7eb28c966b8ad
FAIL (2026-03-01 18:23:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAC2A4670A68</RequestId><HostId></HostId></Error>"
Duration: 10.580601ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.298872ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CAC0994AA3B9 X-Request-Id=BgSe8LZu8Rj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:23:01 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/610994e698972192
FAIL (2026-03-01 18:23:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAC0994AA3B9</RequestId><HostId></HostId></Error>"
Duration: 11.328146ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.426507ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=YtKAq95diAv Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=1898CAC002E8970F X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:22:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/674b3691496e06a8
FAIL (2026-03-01 18:22:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAC002E8970F</RequestId><HostId></HostId></Error>"
Duration: 10.44764ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.504210273s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:22:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.504236566s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
54.175286ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CABD3CAAD1DF X-Request-Id=FcNBh8JnN72 Date=Sun, 01 Mar 2026 18:22:47 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/60db8b08ebb1218c
FAIL (2026-03-01 18:22:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CABD3CAAD1DF</RequestId><HostId></HostId></Error>"
Duration: 54.18601ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.55985038s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:22:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.559880177s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.442984ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=3EGp4QojpDc Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:22:08 GMT Accept-Ranges=bytes X-Amz-Request-Id=1898CAB4263FFD8E target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/172fadd8c24e74df
FAIL (2026-03-01 18:22:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAB4263FFD8E</RequestId><HostId></HostId></Error>"
Duration: 27.465417ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.770877ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:22:07 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CAB3F945E740 X-Request-Id=SnTooNuYPwS Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1e9902d7f6600f61
FAIL (2026-03-01 18:22:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAB3F945E740</RequestId><HostId></HostId></Error>"
Duration: 10.797476ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.451166ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=j6Qs1Mts1SJ X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CAB17993E57A Date=Sun, 01 Mar 2026 18:21:56 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1c82d0cd637bfc81
FAIL (2026-03-01 18:21:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAB17993E57A</RequestId><HostId></HostId></Error>"
Duration: 10.477919ms
edge
gateway
vhost
bgp
ap1
|