Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.917747ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:52:02 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C90FB1E29D3C X-Request-Id=CoAeAmxLR9i Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/605f7e6a53caf1b4
FAIL (2026-03-01 17:52:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C90FB1E29D3C</RequestId><HostId></HostId></Error>"
Duration: 32.005673ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.......................X.] duration:
2.473134456s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 17:51:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.473153705s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.......................X] duration:
1m0.100400662s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 17:51:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.100423144s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.73641ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C90CFAD6F8A1 X-Request-Id=hnL7zS1r9rz Date=Sun, 01 Mar 2026 17:51:50 GMT Content-Length=274 Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1ff230534c1343f6
FAIL (2026-03-01 17:51:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C90CFAD6F8A1</RequestId><HostId></HostId></Error>"
Duration: 9.801231ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.259142ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1898C90BA0630DFC X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:51:45 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=5MmiLYYvPuD target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/751d06b0b795b44d
FAIL (2026-03-01 17:51:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C90BA0630DFC</RequestId><HostId></HostId></Error>"
Duration: 10.284033ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.825475ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C90913B07C64 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:51:34 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=D9wT8ZWDMJ5 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/d729f277ba0982b
FAIL (2026-03-01 17:51:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C90913B07C64</RequestId><HostId></HostId></Error>"
Duration: 14.837697ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.624316ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Date=Sun, 01 Mar 2026 17:51:19 GMT Server=Storj X-Amz-Request-Id=1898C905A5EA1DBE X-Request-Id=JkuKmGSAsfX X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3ad82763bbde4120
FAIL (2026-03-01 17:51:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C905A5EA1DBE</RequestId><HostId></HostId></Error>"
Duration: 26.64882ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.737346ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C9027ACA7964 X-Xss-Protection=1; mode=block Content-Length=274 Vary=Origin X-Request-Id=i14VBekjQUq Date=Sun, 01 Mar 2026 17:51:05 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2ff7b866fe1c8659
FAIL (2026-03-01 17:51:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9027ACA7964</RequestId><HostId></HostId></Error>"
Duration: 11.761081ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.820325ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Sun, 01 Mar 2026 17:50:54 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8FFE353A7C5 X-Request-Id=N84jsJfbBfm X-Xss-Protection=1; mode=block Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/99c0a0003327661
FAIL (2026-03-01 17:50:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8FFE353A7C5</RequestId><HostId></HostId></Error>"
Duration: 30.843696ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.295025ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Date=Sun, 01 Mar 2026 17:50:50 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8FEDF6A5361 X-Request-Id=8QuR4SsnJV6 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/64da98781cbad95
FAIL (2026-03-01 17:50:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8FEDF6A5361</RequestId><HostId></HostId></Error>"
Duration: 9.313976ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
36.143004ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:50:40 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898C8FCA36F58B3 X-Request-Id=d66x5MHtByY Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/79f31fb728673ae3
FAIL (2026-03-01 17:50:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8FCA36F58B3</RequestId><HostId></HostId></Error>"
Duration: 36.162817ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.509612ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:50:38 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C8FC1B1857CC X-Request-Id=VxqAYMxKJgy target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3a57b606f6903e9c
FAIL (2026-03-01 17:50:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8FC1B1857CC</RequestId><HostId></HostId></Error>"
Duration: 15.534529ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
93.483142ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C8F88134B85E X-Request-Id=1JMxFeNvPq X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:50:23 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/33442ff56fd8a810
FAIL (2026-03-01 17:50:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8F88134B85E</RequestId><HostId></HostId></Error>"
Duration: 93.521251ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.582638ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8F642029F8C X-Request-Id=82KNeGpsrH8 Content-Length=274 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:50:13 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7327c0150110d79
FAIL (2026-03-01 17:50:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8F642029F8C</RequestId><HostId></HostId></Error>"
Duration: 11.611852ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.755823ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=Fshx4CBGqva Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C8F18FBA7185 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:49:53 GMT Accept-Ranges=bytes Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/13a5443d4676d724
FAIL (2026-03-01 17:49:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8F18FBA7185</RequestId><HostId></HostId></Error>"
Duration: 10.775947ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.447117ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C8EEA399AE77 X-Request-Id=anH92wBwFWn Date=Sun, 01 Mar 2026 17:49:40 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3311ca34262b5307
FAIL (2026-03-01 17:49:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8EEA399AE77</RequestId><HostId></HostId></Error>"
Duration: 29.470264ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.096989795s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:49:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.09701997s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.308042ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C8EC30473AB1 X-Request-Id=hMxF91vGicA X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:49:30 GMT Content-Length=274 Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7774babb6d367c79
FAIL (2026-03-01 17:49:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8EC30473AB1</RequestId><HostId></HostId></Error>"
Duration: 11.35393ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.327781ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C8EC0DF207F9 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:49:29 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=YN7mqp6TGVt target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7ede0fbaa14816fb
FAIL (2026-03-01 17:49:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8EC0DF207F9</RequestId><HostId></HostId></Error>"
Duration: 15.354209ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.917212ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1898C8E74CB86359 X-Request-Id=Y9STpW4myhy Date=Sun, 01 Mar 2026 17:49:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4411f033b65e9e5a
FAIL (2026-03-01 17:49:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8E74CB86359</RequestId><HostId></HostId></Error>"
Duration: 10.93399ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.403792ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898C8E4A8D24E68 X-Request-Id=XEa7XJQxfkb Date=Sun, 01 Mar 2026 17:48:57 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/484ddaed3f99710f
FAIL (2026-03-01 17:48:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8E4A8D24E68</RequestId><HostId></HostId></Error>"
Duration: 9.429241ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.478046551s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:48:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.478072778s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.471562ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C8E10614BA0D X-Request-Id=HhF9yykFsu4 Date=Sun, 01 Mar 2026 17:48:42 GMT Content-Length=284 Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7605caa8983f1c82
FAIL (2026-03-01 17:48:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8E10614BA0D</RequestId><HostId></HostId></Error>"
Duration: 31.491665ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.890345ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C8DE117E4771 X-Xss-Protection=1; mode=block Content-Length=274 X-Request-Id=ib98xpM2yHi Date=Sun, 01 Mar 2026 17:48:29 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4fb63b776bd5b807
FAIL (2026-03-01 17:48:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8DE117E4771</RequestId><HostId></HostId></Error>"
Duration: 12.912977ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.143208535s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:48:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.143238043s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.987646ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C8D8371E804B X-Request-Id=cUxuQ92wWka Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:48:04 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5d587a5a172f8d99
FAIL (2026-03-01 17:48:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8D8371E804B</RequestId><HostId></HostId></Error>"
Duration: 12.12299ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.494178ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml X-Request-Id=J4JZ9vP2mBe X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C8D75477FE8C Date=Sun, 01 Mar 2026 17:48:00 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/22996e7e029c1400
FAIL (2026-03-01 17:48:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8D75477FE8C</RequestId><HostId></HostId></Error>"
Duration: 28.51835ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.93026ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C8D737648805 X-Request-Id=H6xSbpda6mP X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:48:00 GMT Accept-Ranges=bytes Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2f0c36b9f901ddab
FAIL (2026-03-01 17:48:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8D737648805</RequestId><HostId></HostId></Error>"
Duration: 11.991711ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.198826ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C8D73D5C8C46 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:48:00 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=56hiFRgZDVy target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1166e2bd28bb73a3
FAIL (2026-03-01 17:48:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8D73D5C8C46</RequestId><HostId></HostId></Error>"
Duration: 12.222627ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.46416587s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:47:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.464191042s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.683532ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898C8D242AB92EE X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=22D2nY5VkVD Date=Sun, 01 Mar 2026 17:47:38 GMT Accept-Ranges=bytes Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/126cab69cd90d486
FAIL (2026-03-01 17:47:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8D242AB92EE</RequestId><HostId></HostId></Error>"
Duration: 9.70166ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.579817ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=5fzXGDkgwPL X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:47:28 GMT Content-Type=application/xml Server=Storj Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C8CFDEF60251 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2e49d8f78693d929
FAIL (2026-03-01 17:47:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8CFDEF60251</RequestId><HostId></HostId></Error>"
Duration: 29.650853ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.230628ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8CFA609E55A X-Request-Id=78rwW5wpsLN X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:47:27 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/35b32df6baa573ab
FAIL (2026-03-01 17:47:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8CFA609E55A</RequestId><HostId></HostId></Error>"
Duration: 11.252809ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.836785ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C8CDAF05919C X-Request-Id=aTRbHT7FQah Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:47:19 GMT Content-Length=274 Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/681ec20128454a52
FAIL (2026-03-01 17:47:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8CDAF05919C</RequestId><HostId></HostId></Error>"
Duration: 10.877595ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.154025ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=1898C8CABBA2BE67 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:47:06 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=hdsLX1WrqCg target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2a8c76b0b2fc61e3
FAIL (2026-03-01 17:47:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8CABBA2BE67</RequestId><HostId></HostId></Error>"
Duration: 11.181952ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.931854ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C8C664E3262F X-Request-Id=eHaJFBn82nt Date=Sun, 01 Mar 2026 17:46:47 GMT Accept-Ranges=bytes Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4bfa57b51d859b24
FAIL (2026-03-01 17:46:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8C664E3262F</RequestId><HostId></HostId></Error>"
Duration: 9.945566ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.929296ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:46:42 GMT Content-Type=application/xml Server=Storj X-Request-Id=Wr7qyHEA56X X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C8C525A8D289 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/25e859060174e3a4
FAIL (2026-03-01 17:46:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8C525A8D289</RequestId><HostId></HostId></Error>"
Duration: 11.952137ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.516389551s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:46:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.516418654s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.488773ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C8C3FC924C74 X-Request-Id=bQDXzDtz4Cz Date=Sun, 01 Mar 2026 17:46:37 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4ed8c1ea44e661eb
FAIL (2026-03-01 17:46:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8C3FC924C74</RequestId><HostId></HostId></Error>"
Duration: 9.514774ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.747149ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=CEB1ngus7LD X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:46:33 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C8C2FCD0E03D Accept-Ranges=bytes Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/777b1f330cb732b7
FAIL (2026-03-01 17:46:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8C2FCD0E03D</RequestId><HostId></HostId></Error>"
Duration: 26.766004ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.3187ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C8BAA855DBA1 X-Request-Id=KtrkwBAyGAx X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin Date=Sun, 01 Mar 2026 17:45:57 GMT Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/518a16b6c7367c37
FAIL (2026-03-01 17:45:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8BAA855DBA1</RequestId><HostId></HostId></Error>"
Duration: 19.343526ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.188349ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Request-Id=MH6yWt2YUSD X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:45:49 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C8B8BC591B58 Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1e3c232c186df39a
FAIL (2026-03-01 17:45:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8B8BC591B58</RequestId><HostId></HostId></Error>"
Duration: 30.209933ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.673666ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C8B7B5D6D647 X-Request-Id=csAt2Vc5iaP X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Date=Sun, 01 Mar 2026 17:45:44 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/34153f9130f2c023
FAIL (2026-03-01 17:45:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8B7B5D6D647</RequestId><HostId></HostId></Error>"
Duration: 8.704427ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.487451ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1898C8B7261FDDB9 X-Request-Id=bteUb17oqqe X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:45:42 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3b7e949065045aa5
FAIL (2026-03-01 17:45:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8B7261FDDB9</RequestId><HostId></HostId></Error>"
Duration: 10.517111ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.519798034s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:45:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.519822131s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.670056ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=dNEe3PSonUQ Date=Sun, 01 Mar 2026 17:45:29 GMT Content-Type=application/xml X-Amz-Request-Id=1898C8B40DF68EDD X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/68f03c0273c2af17
FAIL (2026-03-01 17:45:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8B40DF68EDD</RequestId><HostId></HostId></Error>"
Duration: 13.694875ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.832394ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:45:07 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1898C8AF1DA14FC3 X-Request-Id=aPWXbQpP8Y Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/58bbb59c0cfe1923
FAIL (2026-03-01 17:45:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8AF1DA14FC3</RequestId><HostId></HostId></Error>"
Duration: 11.868599ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.902936ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C8AE3E410342 X-Request-Id=Y9b2dYL5XbQ Date=Sun, 01 Mar 2026 17:45:04 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/49d890843992e39f
FAIL (2026-03-01 17:45:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8AE3E410342</RequestId><HostId></HostId></Error>"
Duration: 10.924754ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.304519ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:44:57 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=1898C8ACB57337B2 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=CJBm2wDz8tH target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1e56d491428bf881
FAIL (2026-03-01 17:44:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C8ACB57337B2</RequestId><HostId></HostId></Error>"
Duration: 9.330271ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.091981336s trace:
https://jaeger.dev.storj.io/trace/139bac4346ea757d
FAIL (2026-03-01 17:44:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596492020 (285h15m19.3998512s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596843064 (285h15m19.400202244s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.596901678 (285h15m19.400260856s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.597228519 (285h15m19.400587703s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.602513048 (285h15m19.405872229s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.604711530 (285h15m19.40807071s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.605703762 (285h15m19.409062942s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606265199 (285h15m19.409624379s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.606765833 (285h15m19.410125014s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608060331 (285h15m19.411419513s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:18.608512569 (285h15m19.411871751s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Uploading piece...
Mar 1 17:31:19.031356896 (285h15m19.834716072s) [upload=296858]: Next returned nil segment
Mar 1 17:31:19.031379475 (285h15m19.834738713s) [upload=296858]: Waiting for error group managing segments...
Mar 1 17:31:19.212560775 (285h15m20.01591995s) [noise=true , address=81.171.14.70:4026 , piece_id=43YOPBXTA7POBBRJOJRCKUZ2U6JW7JNNIHCJTZC6RML5UWUYDH6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.217798762 (285h15m20.021157936s) [noise=true , address=81.171.14.70:4031 , piece_id=ZTXVE27CIKCETNDSICQEPAAMZYJOFBNKXAIZ7XSFKP6RDMVAWI5A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.218936822 (285h15m20.022295995s) [noise=true , address=81.171.14.70:4025 , piece_id=WLQUCFX42CKYP7QHJJQNVB453BI4AUPNGXAP6AYUQ3EA5JEKLVYQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.220972618 (285h15m20.024331792s) [noise=true , address=81.171.14.70:4038 , piece_id=JMJY2M6OPMNFP4YJSWT4UYB5AKWFHVLEDYO5DFWOU6VZTCBSKLBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221456821 (285h15m20.024816s) [noise=true , address=81.171.14.70:4034 , piece_id=5VD47NNJJ2G2ITH4EPREQDMROT2FFA5M34FNF5SEA5SN6WCGZSCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.221785064 (285h15m20.025144249s) [noise=true , address=81.171.14.70:4047 , piece_id=63E3ZGELAMYOWQDLTLWPGVSMLKD3QTFY6YACIKCRLN5JFMN4RWLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.222547446 (285h15m20.02590662s) [noise=true , address=89.149.201.147:4003 , piece_id=UXVWYYIEV64DTB4VZ46XDUX5DOD4HZMDAFTIDX5YSSZ6WK2K573Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.226390577 (285h15m20.029749751s) [noise=true , address=185.167.204.205:4033 , piece_id=B46EJO4MQJU5DTEX2NRNUGI3YPQSUNGJMVSXKRTNWWPQ5RPKAVBQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.228285079 (285h15m20.031644247s) [noise=true , address=185.167.204.206:4064 , piece_id=EJVQQK27GC4KFSPGHWKGAFSVRK7COKQIP2JJ4KZEJRNFKEEFRQLA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.230962957 (285h15m20.03432214s) [noise=true , address=89.149.201.147:4023 , piece_id=2YP376VQPYQLX45WFUH4Q4LPPFLPT2H7BWSVFJDDQZBWZMW4VCMA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.249211959 (285h15m20.052571142s) [noise=true , address=89.149.201.147:4021 , piece_id=2AQIZ73RJA6JXCQI44CD2VAVXA7SQUH4FMHPUEKRNGU4T3ARUQBA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.251254434 (285h15m20.054613609s) [noise=true , address=89.149.201.147:4017 , piece_id=XH242K76YZHGYCR6VPGIXPUZLI5K2PV5GDZ5AXWF7M4RV7XWSV2Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.259114390 (285h15m20.062473565s) [noise=true , address=89.149.201.147:4010 , piece_id=QQYGF2VV3YTOXO7TGG4JBZNB4J6L7XVG6LNOMOCM6TIIBUKTZQEQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.265376771 (285h15m20.068735949s) [noise=true , address=81.171.14.70:4030 , piece_id=EDYEWXWIGHBEPSS42KGVT3IQF4MISGDYSEUFBWZBTDLBV6BTW7VQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.269131900 (285h15m20.072491077s) [noise=true , address=185.167.204.205:4017 , piece_id=MSHSHMAWFOO6XODIYX7DMLHJHYC6GIX6N5OQVLEBTJNW3PHFYL3Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.293303338 (285h15m20.096662519s) [noise=true , address=185.167.204.206:4047 , piece_id=4L4NZKSXT34IUULU6WEV3F2GKRBCHS7Y5R2OAPDI377G3GYNY6KA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.300147440 (285h15m20.103506605s) [noise=true , address=185.167.204.205:4030 , piece_id=KWBINRNSKG5AAURMW35OYDCCQJXE7TSMFWCI2P6KTK5KIXP5IX2A, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.304538977 (285h15m20.107898161s) [noise=true , address=185.167.204.205:4011 , piece_id=XCFNRYKR74HUAMQ7RNFDWDNMKLG3APISISQ6N3EJMOGPYERCGCLQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.308601739 (285h15m20.111960913s) [noise=true , address=185.167.204.205:4023 , piece_id=UZGM6BBEEJPJVBP4AH2OP23HFS6GPINZYQG2O2LGTKQWAMCZPIKA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.317615233 (285h15m20.120974413s) [noise=true , address=185.167.204.206:4041 , piece_id=YM6W6LDOOVG3E6YN44RSX2XQV4X4VQCCYBX5IO6IWAVUYK4FD5IA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.336147564 (285h15m20.139506728s) [noise=true , address=185.167.204.206:4056 , piece_id=3TKIS3A3VCGERKTO6SF5646YFSVT4J74V2OLEVB7TRJTHRDVX6BA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345504760 (285h15m20.148863935s) [noise=true , address=185.167.204.205:4021 , piece_id=MICYIYOIUS6RO2LZBHSSEDGUOIAW27TDQKL3JSOFUA2BJAN3CKCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:19.345892255 (285h15m20.149251429s) [noise=true , address=185.167.204.205:4031 , piece_id=VYK7QFAIXH3AA4VGEMOS45IOKZ7Q6J7EA7666MGWBFQVFVBCKG6Q, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:23.054524868 (285h15m23.857884049s) [noise=true , address=185.167.204.205:4012 , piece_id=CIXWGIALDBRWFI6NM2F7D7CBXD33DDMHUH3A5P3HWKDH3BGLVDNQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:31:24.846793318 (285h15m25.650152495s) [noise=true , address=185.167.204.205:4024 , piece_id=A6AECAQAMPV3U6XZFNWQMD4P6CNWXZ53KN2BR3HSDE2X55G62WCQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: <nil>
Mar 1 17:32:18.198614811 (285h16m19.001973997s) [noise=true , address=89.149.201.147:4024 , piece_id=O42VGY37LRUBLS7F6OEVQZ5JZ2Z3D7OWMH2F6JQ4AUKDBH46G3NA, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:42844->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198848484 (285h16m19.002207668s) [noise=true , address=185.167.204.205:4029 , piece_id=ZWXNPE22PJASMPKGHSP2Z3BGYBZAZEVB75MOSRXGSX2CE2VUX5EQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:12DyF12w2JXdkGLfLx9VE1E5f28VnMg7M2b3osfsDtGX9o8Tvsn, address:185.167.204.205:4029): protocol: read tcp 159.223.143.39:50718->185.167.204.205:4029: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198881210 (285h16m19.002240395s) [noise=true , address=185.167.204.206:4066 , piece_id=SH2DILMFF24F5TGHP2QYHPWXOIP3APMPXLSL7RT2RSOOWFZZFTQQ, seg_pos={0 0}, upload=296858]: Done uploading piece. err: ecclient: upload failed (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg, address:185.167.204.206:4066): protocol: read tcp 159.223.143.39:59374->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:32:18.198913636 (285h16m19.0022728s) [seg_pos={0 0}, upload=296858]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:32:18.301534346 (285h16m19.104893528s) [upload=296858]: Done uploading segments...
Mar 1 17:32:18.301593019 (285h16m19.104952205s) [upload=296858]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.092005015s
core
uplink
eu-select-1
eu1-placement-15
|