Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.50401616s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:21:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.504048915s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.903454ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CAAF17B92C03 Date=Sun, 01 Mar 2026 18:21:46 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=25FCk4twX5Z X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/48186f485abce997
FAIL (2026-03-01 18:21:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAAF17B92C03</RequestId><HostId></HostId></Error>"
Duration: 12.925134ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.080002ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 X-Amz-Request-Id=1898CAA9E2025075 X-Request-Id=2nHKkRTmg6c Date=Sun, 01 Mar 2026 18:21:24 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/53b4f739de7aacc9
FAIL (2026-03-01 18:21:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAA9E2025075</RequestId><HostId></HostId></Error>"
Duration: 30.106899ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.122145688s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:21:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.122169757s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.204737ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Sun, 01 Mar 2026 18:21:02 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CAA4D9B7DE51 X-Request-Id=4UUo7k5wPBV X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6e1809f3fbdaf982
FAIL (2026-03-01 18:21:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAA4D9B7DE51</RequestId><HostId></HostId></Error>"
Duration: 12.250268ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.349265ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin Date=Sun, 01 Mar 2026 18:20:59 GMT Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=1898CAA4206150A7 X-Request-Id=ZVPwncaa6kL X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/27fc34cb24bb826
FAIL (2026-03-01 18:20:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAA4206150A7</RequestId><HostId></HostId></Error>"
Duration: 10.3863ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.617142ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=1898CAA350DD6A10 X-Request-Id=74ehTde13eu X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 18:20:56 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/75125d24ddbbe58a
FAIL (2026-03-01 18:20:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAA350DD6A10</RequestId><HostId></HostId></Error>"
Duration: 14.639226ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.014085ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1898CAA325377832 Date=Sun, 01 Mar 2026 18:20:55 GMT Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=ULMvMnM3qy1 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7c7bb22411cd800c
FAIL (2026-03-01 18:20:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CAA325377832</RequestId><HostId></HostId></Error>"
Duration: 28.040885ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.627614ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CA9BC8F49B39 Content-Length=274 Vary=Origin X-Request-Id=9VXddbcHTfo X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:20:23 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/14b817ba3101b965
FAIL (2026-03-01 18:20:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA9BC8F49B39</RequestId><HostId></HostId></Error>"
Duration: 10.650709ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.596493614s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:20:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.596531617s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.831622ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:20:17 GMT Accept-Ranges=bytes X-Amz-Request-Id=1898CA9A562FD65A X-Request-Id=ZTaVgsTXU3A target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2dae234b89154d3c
FAIL (2026-03-01 18:20:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA9A562FD65A</RequestId><HostId></HostId></Error>"
Duration: 10.863142ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.34061ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Vary=Origin Date=Sun, 01 Mar 2026 18:19:53 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898CA94C17A7C1B X-Request-Id=fuKv5VBnAG1 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5a14b1b84e61983e
FAIL (2026-03-01 18:19:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA94C17A7C1B</RequestId><HostId></HostId></Error>"
Duration: 29.365235ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.037517ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 18:19:53 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898CA94D256FE2B X-Request-Id=ajKgXLzSxUd X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/52ab5cb91a4ffdbc
FAIL (2026-03-01 18:19:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA94D256FE2B</RequestId><HostId></HostId></Error>"
Duration: 8.058368ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.309465ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=MqJ4hDcB1TX Accept-Ranges=bytes Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:19:51 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898CA94426BC0B1 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/23585bf74f779960
FAIL (2026-03-01 18:19:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA94426BC0B1</RequestId><HostId></HostId></Error>"
Duration: 11.335691ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.085925ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=WNia3NPaTsQ X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:19:44 GMT Accept-Ranges=bytes X-Amz-Request-Id=1898CA92A4F6BB51 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/207d5930bd08d411
FAIL (2026-03-01 18:19:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA92A4F6BB51</RequestId><HostId></HostId></Error>"
Duration: 13.12157ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.098427226s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:19:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.098449628s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.983723ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CA89BFB25F1A X-Request-Id=i7r1pPypf6D X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:19:06 GMT Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7d33f944b8743a4c
FAIL (2026-03-01 18:19:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA89BFB25F1A</RequestId><HostId></HostId></Error>"
Duration: 11.008413ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.760378ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1898CA894F82ACA1 X-Request-Id=JJbrdRqcxBx Date=Sun, 01 Mar 2026 18:19:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2a859ef8f877e14a
FAIL (2026-03-01 18:19:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA894F82ACA1</RequestId><HostId></HostId></Error>"
Duration: 10.783047ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.728364ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CA8919B32FB4 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:19:03 GMT Content-Type=application/xml Server=Storj X-Request-Id=2RfYnte2sXx Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/395848f7609b164e
FAIL (2026-03-01 18:19:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA8919B32FB4</RequestId><HostId></HostId></Error>"
Duration: 11.754891ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
45.144187ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CA88A8D074BF Date=Sun, 01 Mar 2026 18:19:01 GMT Accept-Ranges=bytes Vary=Origin X-Request-Id=HoRn3RMJRm2 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6509db5fbb9e4b1
FAIL (2026-03-01 18:19:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA88A8D074BF</RequestId><HostId></HostId></Error>"
Duration: 45.170539ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.591869777s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:18:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.591899577s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.686147ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=HVHnFuAxp5U X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:18:38 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898CA83378D065A target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7dc2fcd0d95f963b
FAIL (2026-03-01 18:18:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA83378D065A</RequestId><HostId></HostId></Error>"
Duration: 11.725385ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.174734ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=837XSTMzgRW Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CA831DD4CF59 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:18:37 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/362226ea7c35a47c
FAIL (2026-03-01 18:18:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA831DD4CF59</RequestId><HostId></HostId></Error>"
Duration: 19.20057ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.970667ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:18:18 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CA7EB14A123C X-Request-Id=efSv2iXsqRn Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7cbb4b3a24df8e43
FAIL (2026-03-01 18:18:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA7EB14A123C</RequestId><HostId></HostId></Error>"
Duration: 10.982268ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.84144ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CA7C92295E52 X-Request-Id=7D8ZUEJCTPP Server=Storj X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:18:09 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/24b116328a270399
FAIL (2026-03-01 18:18:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA7C92295E52</RequestId><HostId></HostId></Error>"
Duration: 29.947957ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.485266283s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:17:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.485289896s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.406607ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=9yRGLb5Z1Vr X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CA7700E72C4B Date=Sun, 01 Mar 2026 18:17:45 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/608f1d9be866889a
FAIL (2026-03-01 18:17:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA7700E72C4B</RequestId><HostId></HostId></Error>"
Duration: 11.438817ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.47683ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898CA7694DC1AA5 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:17:44 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=WdxKJZRoAr6 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1b2d3345266a0135
FAIL (2026-03-01 18:17:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA7694DC1AA5</RequestId><HostId></HostId></Error>"
Duration: 14.498509ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.641291ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CA721977960F Date=Sun, 01 Mar 2026 18:17:24 GMT Content-Length=284 Server=Storj X-Request-Id=aXfKtLqiJxu target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/26b9401d3edfc3e7
FAIL (2026-03-01 18:17:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA721977960F</RequestId><HostId></HostId></Error>"
Duration: 26.657188ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.366881ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CA6F78531DDD X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:17:13 GMT Accept-Ranges=bytes X-Request-Id=Um5Srw4XNMw target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1b340222504e0425
FAIL (2026-03-01 18:17:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6F78531DDD</RequestId><HostId></HostId></Error>"
Duration: 10.392313ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.392323ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CA6F5056CAC3 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=U78qkuQWjoF Date=Sun, 01 Mar 2026 18:17:12 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/229d5721845f9ea7
FAIL (2026-03-01 18:17:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6F5056CAC3</RequestId><HostId></HostId></Error>"
Duration: 12.418363ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.111445ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898CA6908E90443 X-Request-Id=4BQtbWSRqoT Date=Sun, 01 Mar 2026 18:16:45 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5ed5895c2cc07ca0
FAIL (2026-03-01 18:16:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6908E90443</RequestId><HostId></HostId></Error>"
Duration: 29.140611ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.228197ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=DBQXqm8R7hW X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:16:41 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CA6810603EC6 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4e5baf2183e9e336
FAIL (2026-03-01 18:16:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6810603EC6</RequestId><HostId></HostId></Error>"
Duration: 14.250827ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.073954983s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:16:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.073984231s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.737369ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898CA6685AED0A9 X-Request-Id=i1ivwf27GX8 Date=Sun, 01 Mar 2026 18:16:35 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6ded872ed6f5b51a
FAIL (2026-03-01 18:16:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6685AED0A9</RequestId><HostId></HostId></Error>"
Duration: 13.755881ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.600795ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CA6578AEBD59 X-Request-Id=VpF6LPfrwKY Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:16:30 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/15ffec767605d66d
FAIL (2026-03-01 18:16:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6578AEBD59</RequestId><HostId></HostId></Error>"
Duration: 29.622133ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.748961ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898CA6014FEF7CA X-Request-Id=eJL9YQVEeyP Date=Sun, 01 Mar 2026 18:16:07 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7fc2f903d1fbb35c
FAIL (2026-03-01 18:16:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA6014FEF7CA</RequestId><HostId></HostId></Error>"
Duration: 14.772628ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.564539ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=1898CA5DE639CFD0 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=8dEgCsbfhXQ Date=Sun, 01 Mar 2026 18:15:58 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/283840e3f4bbd7ac
FAIL (2026-03-01 18:15:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA5DE639CFD0</RequestId><HostId></HostId></Error>"
Duration: 29.585604ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.605956ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CA5B06AB93A1 X-Request-Id=FjihZniVATh X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:15:45 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/265b4377d5691cc5
FAIL (2026-03-01 18:15:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA5B06AB93A1</RequestId><HostId></HostId></Error>"
Duration: 10.629391ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.318674ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Content-Length=274 Server=Storj X-Amz-Request-Id=1898CA58FF72B0CC X-Request-Id=JZGXUtyhrfB X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:15:36 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6aadb8e5b12c45b8
FAIL (2026-03-01 18:15:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA58FF72B0CC</RequestId><HostId></HostId></Error>"
Duration: 12.343074ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.651282ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj X-Request-Id=NHbqpAKYdT8 Date=Sun, 01 Mar 2026 18:15:27 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CA56DA153625 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/726cdcd29297e430
FAIL (2026-03-01 18:15:27 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA56DA153625</RequestId><HostId></HostId></Error>"
Duration: 11.675043ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [X.......................X...................................] duration:
2.084557583s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:15:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.084579372s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
36.379221ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Content-Length=284 Server=Storj X-Request-Id=PnJS8cBqWfM Date=Sun, 01 Mar 2026 18:15:10 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CA52D7598FCB target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5dfc6bb2a2987b87
FAIL (2026-03-01 18:15:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA52D7598FCB</RequestId><HostId></HostId></Error>"
Duration: 36.402161ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.225992ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898CA52B4E8504D X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:15:09 GMT Server=Storj Vary=Origin X-Request-Id=A9fCW5KQuit Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6565c0b1d6aa1609
FAIL (2026-03-01 18:15:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA52B4E8504D</RequestId><HostId></HostId></Error>"
Duration: 18.272181ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.493988ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=1898CA5230C88490 X-Request-Id=NsEALeyh46m Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:15:07 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7ba1bfaf72dee58f
FAIL (2026-03-01 18:15:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA5230C88490</RequestId><HostId></HostId></Error>"
Duration: 11.521695ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.X.......................X..................................] duration:
2.527916092s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:14:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.527939806s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.672133ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=1898CA4E505358FB X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=PohqGJDLtkF Date=Sun, 01 Mar 2026 18:14:51 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3292ee2b4892e763
FAIL (2026-03-01 18:14:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA4E505358FB</RequestId><HostId></HostId></Error>"
Duration: 13.695458ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.71463ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=1898CA4A8F731105 X-Request-Id=nFrkXGjJas Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:14:34 GMT Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1c186a3694301757
FAIL (2026-03-01 18:14:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA4A8F731105</RequestId><HostId></HostId></Error>"
Duration: 27.737709ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..X.......................X.................................] duration:
2.093236726s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:14:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.09326651s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.644234ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 18:14:32 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Content-Length=274 Server=Storj X-Amz-Request-Id=1898CA49FE8E4B28 X-Request-Id=DpeFvwFKH3R X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7a9d75875350df0f
FAIL (2026-03-01 18:14:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CA49FE8E4B28</RequestId><HostId></HostId></Error>"
Duration: 12.659666ms
edge
gateway
vhost
bgp
us1
|