Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.396971ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:06:49 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Content-Length=274 Vary=Origin X-Amz-Request-Id=1898C9DE30BA7F2A X-Request-Id=Fwp6spmnMyV target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1ae3e28b20bcd730
FAIL (2026-03-01 18:06:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9DE30BA7F2A</RequestId><HostId></HostId></Error>"
Duration: 13.418045ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.............X.......................X......................] duration:
2.513830169s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:06:38 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.513861401s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.001895ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Request-Id=8ReJKJJpZ9F Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C9DA0D49F751 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:06:31 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/350964c32dc476ed
FAIL (2026-03-01 18:06:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9DA0D49F751</RequestId><HostId></HostId></Error>"
Duration: 10.034209ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.128265ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898C9D883716402 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=ZUyBES2DySR X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:06:25 GMT Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6d0a0827e9b1d734
FAIL (2026-03-01 18:06:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9D883716402</RequestId><HostId></HostId></Error>"
Duration: 12.145802ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.083447ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=KtRQBbRLtuh X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:06:24 GMT Content-Type=application/xml X-Amz-Request-Id=1898C9D87007741D Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3db707661ed972d8
FAIL (2026-03-01 18:06:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9D87007741D</RequestId><HostId></HostId></Error>"
Duration: 30.115179ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..............X.......................X.....................] duration:
2.132307607s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:06:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.132332464s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.889101ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=itFB3tP696R X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:05:38 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C9CDB3CD688C Accept-Ranges=bytes Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/25945ec021edeadc
FAIL (2026-03-01 18:05:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9CDB3CD688C</RequestId><HostId></HostId></Error>"
Duration: 11.050384ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.181429ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:05:29 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C9CBA3F299DB X-Request-Id=VkzsBe5tLsJ target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/fe3fbe011b275cc
FAIL (2026-03-01 18:05:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9CBA3F299DB</RequestId><HostId></HostId></Error>"
Duration: 14.202554ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...............X.......................X....................] duration:
2.507857067s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:05:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.507886447s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.432635ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=HcVMHvGgAPR X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:05:14 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C9C817D05FFA target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7ead143b9b0a806d
FAIL (2026-03-01 18:05:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9C817D05FFA</RequestId><HostId></HostId></Error>"
Duration: 12.458011ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.638863ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=1898C9C739DE5B6F X-Request-Id=Kczb1LwQ5pE X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Sun, 01 Mar 2026 18:05:10 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/642053876d8b88b0
FAIL (2026-03-01 18:05:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9C739DE5B6F</RequestId><HostId></HostId></Error>"
Duration: 27.651392ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.905064ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:04:44 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C9C1198C144F X-Request-Id=3tuRAbhQQZk target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4328432e7f1700da
FAIL (2026-03-01 18:04:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9C1198C144F</RequestId><HostId></HostId></Error>"
Duration: 26.925065ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.423577ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 18:04:42 GMT Content-Type=application/xml X-Request-Id=6pmaPPjqSvz X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C9C0AB44DE2D target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/15679babece2ab62
FAIL (2026-03-01 18:04:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9C0AB44DE2D</RequestId><HostId></HostId></Error>"
Duration: 9.446315ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [................X.......................X...................] duration:
2.092473151s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:04:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.092502917s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.726004ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:04:39 GMT Content-Type=application/xml X-Amz-Request-Id=1898C9BFF252F85A Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=cMbiNB3GQ65 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6b67bddec337cea9
FAIL (2026-03-01 18:04:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9BFF252F85A</RequestId><HostId></HostId></Error>"
Duration: 22.75557ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.734348ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C9BE524B318F X-Request-Id=cKcL7SS37ju Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:04:32 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7f7d0fb861408acf
FAIL (2026-03-01 18:04:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9BE524B318F</RequestId><HostId></HostId></Error>"
Duration: 12.751508ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.319204ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C9BD6BB05E93 X-Request-Id=2bRExWw62NU Date=Sun, 01 Mar 2026 18:04:28 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4fdc035b1ac778f9
FAIL (2026-03-01 18:04:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9BD6BB05E93</RequestId><HostId></HostId></Error>"
Duration: 31.342703ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.44125ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898C9BB159E0E5B X-Request-Id=UXndDAy1YkW Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:04:18 GMT Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4e1838cfa04b6896
FAIL (2026-03-01 18:04:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9BB159E0E5B</RequestId><HostId></HostId></Error>"
Duration: 10.46509ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.................X.......................X..................] duration:
2.120689316s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:04:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.120716948s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.773974ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Request-Id=G6iNJgYQuwp Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C9B4C9A9409F X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:03:51 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7ceac834a5d5ca6e
FAIL (2026-03-01 18:03:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9B4C9A9409F</RequestId><HostId></HostId></Error>"
Duration: 8.793148ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..................X.......................X.................] duration:
2.104250593s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:03:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.104277313s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.99146ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=1898C9B3621B2A70 X-Request-Id=nSLrQXPZwg X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Sun, 01 Mar 2026 18:03:45 GMT Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4d13eea780bd6216
FAIL (2026-03-01 18:03:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9B3621B2A70</RequestId><HostId></HostId></Error>"
Duration: 26.005884ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.738068ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Vary=Origin X-Amz-Request-Id=1898C9B124A646E2 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=YrU82Ke47bT X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:03:36 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/60166429a39abe52
FAIL (2026-03-01 18:03:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9B124A646E2</RequestId><HostId></HostId></Error>"
Duration: 9.761334ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
34.749092ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj X-Amz-Request-Id=1898C9AC8201E181 X-Request-Id=JMwkiSKMgMM X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Date=Sun, 01 Mar 2026 18:03:16 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/196f37ba1cc581f9
FAIL (2026-03-01 18:03:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9AC8201E181</RequestId><HostId></HostId></Error>"
Duration: 34.764649ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.609494ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:03:14 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898C9AC1017B67C X-Request-Id=LPAWTQjVknq target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/30536d247ebc57f2
FAIL (2026-03-01 18:03:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9AC1017B67C</RequestId><HostId></HostId></Error>"
Duration: 9.636679ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.863477ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C9A7AFD1ECD1 Date=Sun, 01 Mar 2026 18:02:55 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=2nkMyCQerfH X-Xss-Protection=1; mode=block Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/500dfeb6da118150
FAIL (2026-03-01 18:02:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9A7AFD1ECD1</RequestId><HostId></HostId></Error>"
Duration: 14.886408ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.79218ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C9A3D9C30E80 Date=Sun, 01 Mar 2026 18:02:38 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=FjS26pQv8Q2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/718c5ad4afe2bb10
FAIL (2026-03-01 18:02:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9A3D9C30E80</RequestId><HostId></HostId></Error>"
Duration: 9.811815ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...................X.......................X................] duration:
2.47927481s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:02:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.479368357s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.745129ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Date=Sun, 01 Mar 2026 18:02:35 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=1898C9A323F9FDC9 X-Request-Id=FQPJgbmaLNS X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/17014dd7ccdcc40f
FAIL (2026-03-01 18:02:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9A323F9FDC9</RequestId><HostId></HostId></Error>"
Duration: 9.76166ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.234962ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Request-Id=GaAzYvNpwPj Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C9A28A28130E X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:02:33 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6e5fa520aeed89f
FAIL (2026-03-01 18:02:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9A28A28130E</RequestId><HostId></HostId></Error>"
Duration: 28.262017ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.172962ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C99EFACC8C94 X-Request-Id=Z8kbitPhxgG X-Xss-Protection=1; mode=block Accept-Ranges=bytes Date=Sun, 01 Mar 2026 18:02:18 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/25bf20d92cf0a391
FAIL (2026-03-01 18:02:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C99EFACC8C94</RequestId><HostId></HostId></Error>"
Duration: 10.198526ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.688533ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Request-Id=WRYZrxLM9qG X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:02:06 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=1898C99C3D1917D0 Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2d58f2af9b04ec07
FAIL (2026-03-01 18:02:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C99C3D1917D0</RequestId><HostId></HostId></Error>"
Duration: 31.733558ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.466393ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=9iP52ExX9mS Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C99A494FEE87 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:01:57 GMT Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2d968331ab5d9902
FAIL (2026-03-01 18:01:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C99A494FEE87</RequestId><HostId></HostId></Error>"
Duration: 14.490762ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....................X.......................X...............] duration:
2.128599876s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:01:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.128692888s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.601159ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898C99585E86FB3 X-Request-Id=dAGCnQUSiws Date=Sun, 01 Mar 2026 18:01:37 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4bd39281d61e08fe
FAIL (2026-03-01 18:01:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C99585E86FB3</RequestId><HostId></HostId></Error>"
Duration: 28.624871ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.998472ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=WNJr3Gb4Eyi Date=Sun, 01 Mar 2026 18:01:30 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C993D05463F5 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2bbde1a928d2331e
FAIL (2026-03-01 18:01:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C993D05463F5</RequestId><HostId></HostId></Error>"
Duration: 11.024442ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.71055ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Request-Id=W9UiorA9MMA X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898C993B12A753D Date=Sun, 01 Mar 2026 18:01:29 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/332736a85ce3cda0
FAIL (2026-03-01 18:01:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C993B12A753D</RequestId><HostId></HostId></Error>"
Duration: 9.767512ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.948748ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:01:11 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C98F82BABB19 X-Request-Id=2t57zffMJns target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/61eda6d793ed83fa
FAIL (2026-03-01 18:01:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C98F82BABB19</RequestId><HostId></HostId></Error>"
Duration: 30.005354ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.940335ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Date=Sun, 01 Mar 2026 18:01:02 GMT Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1898C98D7D164207 X-Request-Id=gXgYMz3xhMT X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/42bdbcedbcbc6189
FAIL (2026-03-01 18:01:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C98D7D164207</RequestId><HostId></HostId></Error>"
Duration: 13.138237ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.383671ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C98B660BDC6D Content-Length=274 Server=Storj Vary=Origin X-Request-Id=GhqZeFDLeYs X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:00:53 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5d41c5dab0acaf41
FAIL (2026-03-01 18:00:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C98B660BDC6D</RequestId><HostId></HostId></Error>"
Duration: 13.400418ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.......................X..............] duration:
2.518149376s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:00:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.518328477s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.556213ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898C9843FEBA38C X-Request-Id=MWC4RrDMNnm Date=Sun, 01 Mar 2026 18:00:23 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4c2adff408bf6756
FAIL (2026-03-01 18:00:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9843FEBA38C</RequestId><HostId></HostId></Error>"
Duration: 11.570392ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......................X.......................X.............] duration:
2.644701627s trace:
https://jaeger.dev.storj.io/trace/1714bb364882ae7
FAIL (2026-03-01 18:00:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
e=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.592990104 (285h34m51.396349289s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593281077 (285h34m51.39664026s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593467911 (285h34m51.396827097s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.593988834 (285h34m51.397348013s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.594747423 (285h34m51.398106609s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.595440292 (285h34m51.398799477s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596060855 (285h34m51.399420042s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.596662398 (285h34m51.400021583s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597156952 (285h34m51.400516131s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.597797496 (285h34m51.401156681s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:50.601483903 (285h34m51.40484307s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Uploading piece...
Mar 1 17:50:51.072199575 (285h34m51.87555875s) [upload=297198]: Next returned nil segment
Mar 1 17:50:51.072208489 (285h34m51.875567667s) [upload=297198]: Waiting for error group managing segments...
Mar 1 17:50:51.229699469 (285h34m52.033058643s) [noise=true , address=81.171.14.70:4046 , piece_id=MDMDIS4HFBI2AON44DXPEUHHWFY3SVJOOWKSLZLH2UVNN7HHHIOA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.240537073 (285h34m52.043896249s) [noise=true , address=81.171.14.70:4025 , piece_id=2MZEL6PW5CE7CRHCTQNASKTHML5OZSO2FYVA3JXFY3PTVD4VQ76A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.242433161 (285h34m52.045792336s) [noise=true , address=81.171.14.70:4033 , piece_id=2SVSM45QSCNEOHH5BGETUMEV7FTBWHB6K3XNY7LIC3EGTBYJDOTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.243381421 (285h34m52.046740599s) [noise=true , address=89.149.201.147:4020 , piece_id=UV3YSVPT535D64N7NWFMZR4TOZVYIIZZKQCL7RD67QNY5ILY3WEA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247170664 (285h34m52.050529828s) [noise=true , address=89.149.201.147:4016 , piece_id=HNANZHJKSLVJMG47RVMLLZ65C2SZJDEGXHIUGS2KNVBUWU2YV3KA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.247630239 (285h34m52.050989416s) [noise=true , address=81.171.14.70:4045 , piece_id=WYE2KNDLP2NWQ2WHBWT27A3GEGBYHUV6PBFAUZGSLH2RLJA7SYTQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.248632442 (285h34m52.051991607s) [noise=true , address=81.171.14.70:4040 , piece_id=PZGJB2IOQUJU3PKIL2ULOHJPOCGYZDJUUFERTL6CHVSVNHTTZQQA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.252726266 (285h34m52.056085441s) [noise=true , address=185.167.204.206:4070 , piece_id=66BX5H5H5FWEHGMGSGM34MRMMQLNTWG54WOIJUHP64UNYPXEEV7A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.254978063 (285h34m52.058337238s) [noise=true , address=89.149.201.147:4008 , piece_id=HK2UPAKQUEV277DATFAXRMVJ2I5FGYEBAAJTVZZBLNB5XY24WPJA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.255376592 (285h34m52.058735766s) [noise=true , address=185.167.204.205:4036 , piece_id=Z4IHUQ6J7MGYBWBGBMQ3ZZWSMWZOWCOQHSFLVSZ3QZIAS4ZEL7WA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.259636748 (285h34m52.06299593s) [noise=true , address=81.171.14.70:4044 , piece_id=2MK6LAL4KYCC75OOLM4B7DZX7DHAOQSQB6KQ6IMUIYRDMNFD6NTA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.260088766 (285h34m52.063447941s) [noise=true , address=81.171.14.70:4032 , piece_id=TP3DJYUYZVA6X5UFWNXA6EQW7GBKV76PYUQ3NWUIMC7T5TIT7V4A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.263553786 (285h34m52.066912965s) [noise=true , address=185.167.204.206:4048 , piece_id=NEIQD6ZO6HTY7P3FGNJJ66KAJTHHA4VJMTXQ7T2PQHYR7XVTM5BQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.267390737 (285h34m52.070749917s) [noise=true , address=81.171.14.70:4038 , piece_id=GZMICSKS4LN7CTIH3RD62YHNKHG6CJWXJBAT2VLOG5WFK5F7M5NA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272420023 (285h34m52.0757792s) [noise=true , address=81.171.14.70:4030 , piece_id=RDNIKKS6AQ3DHSCHAUSM2INLDQFUQM6VHDV3L6T4DNYYMXZYUMVA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.272548287 (285h34m52.075907461s) [noise=true , address=185.167.204.205:4017 , piece_id=PDQWK2OTU6Q62D42CBZQCJ7EU723GDBSK6G6I2EHWMCSZK3NTVGA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.284057486 (285h34m52.087416664s) [noise=true , address=81.171.14.70:4034 , piece_id=FR245FOAQ7PKT32DPRK2NTDDPME3GWYLGMDK5H2ZSWMKBRUJ33AQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.301691602 (285h34m52.105050775s) [noise=true , address=185.167.204.205:4012 , piece_id=ENANBOIXWGGRVTTE7IC6LUTZXYHMA6OR6DITYD7D27IUYZNCYZYA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305223584 (285h34m52.108582749s) [noise=true , address=185.167.204.206:4040 , piece_id=QZWVQXCAEZN4SMHUHHOSK2FPWTFX2WQQ5URFLCIZEDK5BYYG7AJQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.305782158 (285h34m52.109141323s) [noise=true , address=185.167.204.205:4007 , piece_id=UOZ7X2ONKETUW7BCM53PLTLC7UYDKBM4VZLHE7XSDA2UJKY7QBZQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.317913477 (285h34m52.121272652s) [noise=true , address=89.149.201.147:4003 , piece_id=2ZC3CQ5O2HRS6R6ZNTT5HVIXO5JDXARYUHHFQ27DHG5Y52WKMB3A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.333040674 (285h34m52.136399847s) [noise=true , address=185.167.204.205:4035 , piece_id=44ER7WB2NSOXK4CA7TJ5NXYLHI2PATDKXZUAPQCRTU4ACLVVZIQQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:51.728950565 (285h34m52.532309749s) [noise=true , address=81.171.14.70:4031 , piece_id=BFDBTBCUUMW2CHK7V3IEG7S2JZUO5656KUWV6WNZ37VBC4GTS75A, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:50:59.254358696 (285h35m0.057717874s) [noise=true , address=185.167.204.206:4060 , piece_id=7CB4RTLMM64ADLXFQWAMWDIQA5VV6SK2XR57S5D5UY76WEPJJGKA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:47.924585950 (285h35m48.727945146s) [noise=true , address=185.167.204.205:4019 , piece_id=H6BYYQWIV62UEA7MVULYZ72COHMSFWJKGTB36T4DDC7JWWAD3EYQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: <nil>
Mar 1 17:51:50.216010704 (285h35m51.019369884s) [noise=true , address=89.149.201.147:4010 , piece_id=TQ7TMJAZRNYLA4YQZ4Z6VM7L6NIEOL7J3WJCGOLG7ZKRJQMKUA2Q, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:47352->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216038176 (285h35m51.019397363s) [noise=true , address=89.149.201.147:4005 , piece_id=EIV2IE3Y6LDBPDPK7XPHAOTHAAZGPVLZWT44ZCYNENGOEAH33RSQ, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:44402->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216336113 (285h35m51.019695296s) [noise=true , address=89.149.201.147:4011 , piece_id=C2UZZPXEV36KGKHIKWFIEWEPWC7L6SP75WE3CKOKP2HG7N5QG5VA, seg_pos={0 0}, upload=297198]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:44042->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:50.216380576 (285h35m51.019739756s) [seg_pos={0 0}, upload=297198]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:50.313652312 (285h35m51.117011496s) [upload=297198]: Done uploading segments...
Mar 1 17:51:50.313705036 (285h35m51.117064217s) [upload=297198]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.644719195s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.373504ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:00:08 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898C980EDD7277D X-Request-Id=G3wh8UXETHg target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/85eb64b1458f04d
FAIL (2026-03-01 18:00:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C980EDD7277D</RequestId><HostId></HostId></Error>"
Duration: 28.458216ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.590851ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 17:59:59 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1898C97EA73010BE X-Request-Id=EWwXrKz8jxK target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/107041b70e2c9142
FAIL (2026-03-01 17:59:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C97EA73010BE</RequestId><HostId></HostId></Error>"
Duration: 10.610522ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.140578ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898C97E687C351C Date=Sun, 01 Mar 2026 17:59:58 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=KUPCpoisDPi X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/536dee67c1a4584c
FAIL (2026-03-01 17:59:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C97E687C351C</RequestId><HostId></HostId></Error>"
Duration: 23.244014ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.214426ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898C97BA1C88F4B X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj X-Request-Id=iHts4CojgL7 Date=Sun, 01 Mar 2026 17:59:46 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2b10e4f33be58af6
FAIL (2026-03-01 17:59:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C97BA1C88F4B</RequestId><HostId></HostId></Error>"
Duration: 27.235123ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.867389ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=1898C97AEE1576D9 X-Request-Id=VYMofctRQHd X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:59:43 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/43d9db1beee87251
FAIL (2026-03-01 17:59:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C97AEE1576D9</RequestId><HostId></HostId></Error>"
Duration: 9.90762ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
73.539443ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes X-Amz-Request-Id=1898C979005FC609 X-Request-Id=VcuhqY1juxq Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 17:59:34 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6b2313c3f1a68c32
FAIL (2026-03-01 17:59:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C979005FC609</RequestId><HostId></HostId></Error>"
Duration: 73.556741ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.26317ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 X-Amz-Request-Id=1898C9779D2AF254 Date=Sun, 01 Mar 2026 17:59:28 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=cb7w25umJ5x X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/8a315aa4e95a038
FAIL (2026-03-01 17:59:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898C9779D2AF254</RequestId><HostId></HostId></Error>"
Duration: 28.303571ms
edge
gateway
vhost
us-select-1
|