Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [............X..X.X.............................X...X........] duration:
2.179848514s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:48:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.179968673s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.............X..X.X.............................X...X.......] duration:
2.657027613s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:48:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.657097169s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..............X..X.X.............................X...X......] duration:
2.610942613s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:48:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.610969238s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [...............X..X.X.............................X...X.....] duration:
2.571460979s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:46:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.571485133s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [................X..X.X.............................X...X....] duration:
2.514839123s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:46:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.514867158s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.................X..X.X.............................X...X...] duration:
2.570067971s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:46:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.570109611s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..................X..X.X.............................X...X..] duration:
3.60884599s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:45:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.60888412s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [...................X..X.X.............................X...X.] duration:
4.019551963s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:44:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.019588769s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [....................X..X.X.............................X...X] duration:
1m0.109978445s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:44:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.109999245s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................X..X.X.............................X...] duration:
3.199307927s trace:
https://jaeger.dev.storj.io/trace/33752fea3305bd8d
FAIL (2026-03-17 18:42:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
se=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.944794922 (271h39m52.541565951s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945017479 (271h39m52.541788875s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945521421 (271h39m52.542292443s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.946614388 (271h39m52.543385404s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.947366504 (271h39m52.544137519s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.949624084 (271h39m52.546395097s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.951802585 (271h39m52.548573595s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.952826022 (271h39m52.549597032s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.954763434 (271h39m52.551534443s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.956483988 (271h39m52.553255018s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.958634666 (271h39m52.55540568s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:55.360240171 (271h39m52.957011208s) [upload=304281]: Next returned nil segment
Mar 17 18:39:55.360305294 (271h39m52.957076318s) [upload=304281]: Waiting for error group managing segments...
Mar 17 18:39:55.532849615 (271h39m53.12962065s) [noise=true , address=81.171.14.70:4031 , piece_id=VPVDZMA3MJEY3ZREJ6XDXC2YGQRPEV6JJNPKYPHHLPUZ5OEK5HKQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.544004091 (271h39m53.140775116s) [noise=true , address=81.171.14.70:4027 , piece_id=MZPN4EJADJ72HET73DXQT7WUEHRRC5T2URGAIKHJ3VE5RI2BLVAA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.547958091 (271h39m53.144729115s) [noise=true , address=89.149.201.147:4015 , piece_id=LN2GJLB6U7MX5AJE4AR5UNEN4T5NRQU6GLLKOVWBIK6JLWANBUIQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.548989127 (271h39m53.145760149s) [noise=true , address=185.167.204.206:4066 , piece_id=LPGOI4YPSDUBXO4YYPECEWBRJHVK6237ZI7S24OAPI3HC5YUVYJQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.557449887 (271h39m53.15422091s) [noise=true , address=81.171.14.70:4039 , piece_id=5A3QPKF3RSZZQVKFYFHNBTCRLFYG5LJ5GYIVUZNLLQ5OWXMEE7LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.563736181 (271h39m53.160507194s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.575117013 (271h39m53.171888043s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.576829416 (271h39m53.173600447s) [noise=true , address=81.171.14.70:4040 , piece_id=K6BOAYP2PEWRERWMPX4HIWIU6GKLY5O4TW4EB5AICIAH63UDUC7A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.584693445 (271h39m53.181464478s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.585971035 (271h39m53.182742068s) [noise=true , address=185.167.204.205:4019 , piece_id=4YSNOHHDYBWEGC4RVHTKNZCN7UOLBPZFNOAWKOWVLLCHRR3V43BA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.597414443 (271h39m53.19418547s) [noise=true , address=185.167.204.206:4063 , piece_id=ZF76SNCOLSGFD73MBYJPZEPYYX37NNGRVLHMKS6DGUB6HJTDY5LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.600065681 (271h39m53.196836714s) [noise=true , address=89.149.201.147:4001 , piece_id=PY6WN2WTZRCCKEDOJPNTQPDDXPVSLO3EISH5RMHHRTKZUAGT36NQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.621003392 (271h39m53.217774405s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.629148346 (271h39m53.225919377s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.633733844 (271h39m53.230504867s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.649661455 (271h39m53.246432479s) [noise=true , address=185.167.204.205:4014 , piece_id=S2Z2GPC2KSSPNPQIIDC647OUWOQO4S4L43HLFPRX2RZA546YTWCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.652841735 (271h39m53.24961277s) [noise=true , address=185.167.204.205:4005 , piece_id=3FGBLFPYEJ64ER4DXBG2UHRMGKMK6QVPB3SVR6YH23UYCPCYRICA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.665175985 (271h39m53.261947009s) [noise=true , address=185.167.204.206:4060 , piece_id=JMXC6HFV5PM43TZK4JSDWHJU353UQCRHSCGLQ634EUHNI6JREYCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.691540518 (271h39m53.288311556s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.698803867 (271h39m53.29557489s) [noise=true , address=89.149.201.147:4021 , piece_id=6JQHBS64NJ56SGNNBEGTCY7HY2ARRCYFVMBUIQSBRFC6C5T5N4GA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.706574733 (271h39m53.303345756s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.053076996 (271h39m53.649848022s) [noise=true , address=89.149.201.147:4023 , piece_id=I55ZIUTNES24YDFJUAAW6S42Z5THGUVUQUJN3TPJYMWA24RYJG4A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.136475245 (271h39m53.733246296s) [noise=true , address=185.167.204.206:4053 , piece_id=ZPDZKABFYSPAYW5Q7XXRYONB5DYM73SZS7TFGTX3OWOV3D5C3N3A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.770416096 (271h39m54.367187105s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:57.930704735 (271h39m55.527475745s) [noise=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:40:54.568915904 (271h40m52.165686941s) [noise=true , address=89.149.201.147:4014 , piece_id=HUUF5LDYOGQWAMRUA2JAHTUM7T77SAIAEQYKFAJIOGUPTQMC4FHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:55602->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569187426 (271h40m52.165958453s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:40584->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569386427 (271h40m52.166157464s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:39506->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569430305 (271h40m52.166201327s) [seg_pos={0 0}, upload=304281]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:40:54.670141889 (271h40m52.266912915s) [upload=304281]: Done uploading segments...
Mar 17 18:40:54.670203767 (271h40m52.266974801s) [upload=304281]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.199331766s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [X.....................X..X.X.............................X..] duration:
2.580349441s trace:
https://jaeger.dev.storj.io/trace/33752fea3305bd8d
FAIL (2026-03-17 18:42:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
se=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.944794922 (271h39m52.541565951s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945017479 (271h39m52.541788875s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945521421 (271h39m52.542292443s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.946614388 (271h39m52.543385404s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.947366504 (271h39m52.544137519s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.949624084 (271h39m52.546395097s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.951802585 (271h39m52.548573595s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.952826022 (271h39m52.549597032s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.954763434 (271h39m52.551534443s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.956483988 (271h39m52.553255018s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.958634666 (271h39m52.55540568s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:55.360240171 (271h39m52.957011208s) [upload=304281]: Next returned nil segment
Mar 17 18:39:55.360305294 (271h39m52.957076318s) [upload=304281]: Waiting for error group managing segments...
Mar 17 18:39:55.532849615 (271h39m53.12962065s) [noise=true , address=81.171.14.70:4031 , piece_id=VPVDZMA3MJEY3ZREJ6XDXC2YGQRPEV6JJNPKYPHHLPUZ5OEK5HKQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.544004091 (271h39m53.140775116s) [noise=true , address=81.171.14.70:4027 , piece_id=MZPN4EJADJ72HET73DXQT7WUEHRRC5T2URGAIKHJ3VE5RI2BLVAA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.547958091 (271h39m53.144729115s) [noise=true , address=89.149.201.147:4015 , piece_id=LN2GJLB6U7MX5AJE4AR5UNEN4T5NRQU6GLLKOVWBIK6JLWANBUIQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.548989127 (271h39m53.145760149s) [noise=true , address=185.167.204.206:4066 , piece_id=LPGOI4YPSDUBXO4YYPECEWBRJHVK6237ZI7S24OAPI3HC5YUVYJQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.557449887 (271h39m53.15422091s) [noise=true , address=81.171.14.70:4039 , piece_id=5A3QPKF3RSZZQVKFYFHNBTCRLFYG5LJ5GYIVUZNLLQ5OWXMEE7LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.563736181 (271h39m53.160507194s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.575117013 (271h39m53.171888043s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.576829416 (271h39m53.173600447s) [noise=true , address=81.171.14.70:4040 , piece_id=K6BOAYP2PEWRERWMPX4HIWIU6GKLY5O4TW4EB5AICIAH63UDUC7A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.584693445 (271h39m53.181464478s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.585971035 (271h39m53.182742068s) [noise=true , address=185.167.204.205:4019 , piece_id=4YSNOHHDYBWEGC4RVHTKNZCN7UOLBPZFNOAWKOWVLLCHRR3V43BA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.597414443 (271h39m53.19418547s) [noise=true , address=185.167.204.206:4063 , piece_id=ZF76SNCOLSGFD73MBYJPZEPYYX37NNGRVLHMKS6DGUB6HJTDY5LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.600065681 (271h39m53.196836714s) [noise=true , address=89.149.201.147:4001 , piece_id=PY6WN2WTZRCCKEDOJPNTQPDDXPVSLO3EISH5RMHHRTKZUAGT36NQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.621003392 (271h39m53.217774405s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.629148346 (271h39m53.225919377s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.633733844 (271h39m53.230504867s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.649661455 (271h39m53.246432479s) [noise=true , address=185.167.204.205:4014 , piece_id=S2Z2GPC2KSSPNPQIIDC647OUWOQO4S4L43HLFPRX2RZA546YTWCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.652841735 (271h39m53.24961277s) [noise=true , address=185.167.204.205:4005 , piece_id=3FGBLFPYEJ64ER4DXBG2UHRMGKMK6QVPB3SVR6YH23UYCPCYRICA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.665175985 (271h39m53.261947009s) [noise=true , address=185.167.204.206:4060 , piece_id=JMXC6HFV5PM43TZK4JSDWHJU353UQCRHSCGLQ634EUHNI6JREYCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.691540518 (271h39m53.288311556s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.698803867 (271h39m53.29557489s) [noise=true , address=89.149.201.147:4021 , piece_id=6JQHBS64NJ56SGNNBEGTCY7HY2ARRCYFVMBUIQSBRFC6C5T5N4GA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.706574733 (271h39m53.303345756s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.053076996 (271h39m53.649848022s) [noise=true , address=89.149.201.147:4023 , piece_id=I55ZIUTNES24YDFJUAAW6S42Z5THGUVUQUJN3TPJYMWA24RYJG4A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.136475245 (271h39m53.733246296s) [noise=true , address=185.167.204.206:4053 , piece_id=ZPDZKABFYSPAYW5Q7XXRYONB5DYM73SZS7TFGTX3OWOV3D5C3N3A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.770416096 (271h39m54.367187105s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:57.930704735 (271h39m55.527475745s) [noise=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:40:54.568915904 (271h40m52.165686941s) [noise=true , address=89.149.201.147:4014 , piece_id=HUUF5LDYOGQWAMRUA2JAHTUM7T77SAIAEQYKFAJIOGUPTQMC4FHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:55602->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569187426 (271h40m52.165958453s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:40584->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569386427 (271h40m52.166157464s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:39506->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569430305 (271h40m52.166201327s) [seg_pos={0 0}, upload=304281]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:40:54.670141889 (271h40m52.266912915s) [upload=304281]: Done uploading segments...
Mar 17 18:40:54.670203767 (271h40m52.266974801s) [upload=304281]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.580372188s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.X.....................X..X.X.............................X.] duration:
2.102651942s trace:
https://jaeger.dev.storj.io/trace/33752fea3305bd8d
FAIL (2026-03-17 18:40:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
se=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.944794922 (271h39m52.541565951s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945017479 (271h39m52.541788875s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945521421 (271h39m52.542292443s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.946614388 (271h39m52.543385404s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.947366504 (271h39m52.544137519s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.949624084 (271h39m52.546395097s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.951802585 (271h39m52.548573595s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.952826022 (271h39m52.549597032s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.954763434 (271h39m52.551534443s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.956483988 (271h39m52.553255018s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.958634666 (271h39m52.55540568s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:55.360240171 (271h39m52.957011208s) [upload=304281]: Next returned nil segment
Mar 17 18:39:55.360305294 (271h39m52.957076318s) [upload=304281]: Waiting for error group managing segments...
Mar 17 18:39:55.532849615 (271h39m53.12962065s) [noise=true , address=81.171.14.70:4031 , piece_id=VPVDZMA3MJEY3ZREJ6XDXC2YGQRPEV6JJNPKYPHHLPUZ5OEK5HKQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.544004091 (271h39m53.140775116s) [noise=true , address=81.171.14.70:4027 , piece_id=MZPN4EJADJ72HET73DXQT7WUEHRRC5T2URGAIKHJ3VE5RI2BLVAA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.547958091 (271h39m53.144729115s) [noise=true , address=89.149.201.147:4015 , piece_id=LN2GJLB6U7MX5AJE4AR5UNEN4T5NRQU6GLLKOVWBIK6JLWANBUIQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.548989127 (271h39m53.145760149s) [noise=true , address=185.167.204.206:4066 , piece_id=LPGOI4YPSDUBXO4YYPECEWBRJHVK6237ZI7S24OAPI3HC5YUVYJQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.557449887 (271h39m53.15422091s) [noise=true , address=81.171.14.70:4039 , piece_id=5A3QPKF3RSZZQVKFYFHNBTCRLFYG5LJ5GYIVUZNLLQ5OWXMEE7LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.563736181 (271h39m53.160507194s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.575117013 (271h39m53.171888043s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.576829416 (271h39m53.173600447s) [noise=true , address=81.171.14.70:4040 , piece_id=K6BOAYP2PEWRERWMPX4HIWIU6GKLY5O4TW4EB5AICIAH63UDUC7A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.584693445 (271h39m53.181464478s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.585971035 (271h39m53.182742068s) [noise=true , address=185.167.204.205:4019 , piece_id=4YSNOHHDYBWEGC4RVHTKNZCN7UOLBPZFNOAWKOWVLLCHRR3V43BA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.597414443 (271h39m53.19418547s) [noise=true , address=185.167.204.206:4063 , piece_id=ZF76SNCOLSGFD73MBYJPZEPYYX37NNGRVLHMKS6DGUB6HJTDY5LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.600065681 (271h39m53.196836714s) [noise=true , address=89.149.201.147:4001 , piece_id=PY6WN2WTZRCCKEDOJPNTQPDDXPVSLO3EISH5RMHHRTKZUAGT36NQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.621003392 (271h39m53.217774405s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.629148346 (271h39m53.225919377s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.633733844 (271h39m53.230504867s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.649661455 (271h39m53.246432479s) [noise=true , address=185.167.204.205:4014 , piece_id=S2Z2GPC2KSSPNPQIIDC647OUWOQO4S4L43HLFPRX2RZA546YTWCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.652841735 (271h39m53.24961277s) [noise=true , address=185.167.204.205:4005 , piece_id=3FGBLFPYEJ64ER4DXBG2UHRMGKMK6QVPB3SVR6YH23UYCPCYRICA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.665175985 (271h39m53.261947009s) [noise=true , address=185.167.204.206:4060 , piece_id=JMXC6HFV5PM43TZK4JSDWHJU353UQCRHSCGLQ634EUHNI6JREYCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.691540518 (271h39m53.288311556s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.698803867 (271h39m53.29557489s) [noise=true , address=89.149.201.147:4021 , piece_id=6JQHBS64NJ56SGNNBEGTCY7HY2ARRCYFVMBUIQSBRFC6C5T5N4GA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.706574733 (271h39m53.303345756s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.053076996 (271h39m53.649848022s) [noise=true , address=89.149.201.147:4023 , piece_id=I55ZIUTNES24YDFJUAAW6S42Z5THGUVUQUJN3TPJYMWA24RYJG4A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.136475245 (271h39m53.733246296s) [noise=true , address=185.167.204.206:4053 , piece_id=ZPDZKABFYSPAYW5Q7XXRYONB5DYM73SZS7TFGTX3OWOV3D5C3N3A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.770416096 (271h39m54.367187105s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:57.930704735 (271h39m55.527475745s) [noise=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:40:54.568915904 (271h40m52.165686941s) [noise=true , address=89.149.201.147:4014 , piece_id=HUUF5LDYOGQWAMRUA2JAHTUM7T77SAIAEQYKFAJIOGUPTQMC4FHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:55602->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569187426 (271h40m52.165958453s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:40584->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569386427 (271h40m52.166157464s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:39506->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569430305 (271h40m52.166201327s) [seg_pos={0 0}, upload=304281]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:40:54.670141889 (271h40m52.266912915s) [upload=304281]: Done uploading segments...
Mar 17 18:40:54.670203767 (271h40m52.266974801s) [upload=304281]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.102702761s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..X.....................X..X.X.............................X] duration:
1m0.105905149s trace:
https://jaeger.dev.storj.io/trace/33752fea3305bd8d
FAIL (2026-03-17 18:40:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
se=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.944794922 (271h39m52.541565951s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945017479 (271h39m52.541788875s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.945521421 (271h39m52.542292443s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.946614388 (271h39m52.543385404s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.947366504 (271h39m52.544137519s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.949624084 (271h39m52.546395097s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.951802585 (271h39m52.548573595s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.952826022 (271h39m52.549597032s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.954763434 (271h39m52.551534443s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.956483988 (271h39m52.553255018s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:54.958634666 (271h39m52.55540568s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Uploading piece...
Mar 17 18:39:55.360240171 (271h39m52.957011208s) [upload=304281]: Next returned nil segment
Mar 17 18:39:55.360305294 (271h39m52.957076318s) [upload=304281]: Waiting for error group managing segments...
Mar 17 18:39:55.532849615 (271h39m53.12962065s) [noise=true , address=81.171.14.70:4031 , piece_id=VPVDZMA3MJEY3ZREJ6XDXC2YGQRPEV6JJNPKYPHHLPUZ5OEK5HKQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.544004091 (271h39m53.140775116s) [noise=true , address=81.171.14.70:4027 , piece_id=MZPN4EJADJ72HET73DXQT7WUEHRRC5T2URGAIKHJ3VE5RI2BLVAA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.547958091 (271h39m53.144729115s) [noise=true , address=89.149.201.147:4015 , piece_id=LN2GJLB6U7MX5AJE4AR5UNEN4T5NRQU6GLLKOVWBIK6JLWANBUIQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.548989127 (271h39m53.145760149s) [noise=true , address=185.167.204.206:4066 , piece_id=LPGOI4YPSDUBXO4YYPECEWBRJHVK6237ZI7S24OAPI3HC5YUVYJQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.557449887 (271h39m53.15422091s) [noise=true , address=81.171.14.70:4039 , piece_id=5A3QPKF3RSZZQVKFYFHNBTCRLFYG5LJ5GYIVUZNLLQ5OWXMEE7LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.563736181 (271h39m53.160507194s) [noise=true , address=185.167.204.205:4020 , piece_id=TO25AN4L4WFXPRR7RZKO3S4HPL27MO37YAWBMWBP7RRQH5HT6WOA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.575117013 (271h39m53.171888043s) [noise=true , address=89.149.201.147:4002 , piece_id=KRDLJL57ZFYP3CMAJJ5A6FCYVYXVGJ3J2XMXX2N5CAHEXNZ6FUFA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.576829416 (271h39m53.173600447s) [noise=true , address=81.171.14.70:4040 , piece_id=K6BOAYP2PEWRERWMPX4HIWIU6GKLY5O4TW4EB5AICIAH63UDUC7A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.584693445 (271h39m53.181464478s) [noise=true , address=81.171.14.70:4047 , piece_id=O7F6L5TZLSGMRM7ISO32WWGXBGR2KPQSQ2ZRXY35XWIVVF4PA5VQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.585971035 (271h39m53.182742068s) [noise=true , address=185.167.204.205:4019 , piece_id=4YSNOHHDYBWEGC4RVHTKNZCN7UOLBPZFNOAWKOWVLLCHRR3V43BA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.597414443 (271h39m53.19418547s) [noise=true , address=185.167.204.206:4063 , piece_id=ZF76SNCOLSGFD73MBYJPZEPYYX37NNGRVLHMKS6DGUB6HJTDY5LA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.600065681 (271h39m53.196836714s) [noise=true , address=89.149.201.147:4001 , piece_id=PY6WN2WTZRCCKEDOJPNTQPDDXPVSLO3EISH5RMHHRTKZUAGT36NQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.621003392 (271h39m53.217774405s) [noise=true , address=89.149.201.147:4010 , piece_id=EHDVJ6WONDPCSKAORQIMAYWIJKBYAJVWO5UT44UZ7FMS43TT6ABA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.629148346 (271h39m53.225919377s) [noise=true , address=185.167.204.206:4047 , piece_id=OS3JZ54TXWAX57PN66UOL6L6YMYSRKCH4ZURSXUOMTOSSFQPQYYQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.633733844 (271h39m53.230504867s) [noise=true , address=185.167.204.206:4043 , piece_id=S4SDFBCSGZZI57AFTOWL5WCP57QQO6GKKH5HIY6W2WIZJFAWOVUQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.649661455 (271h39m53.246432479s) [noise=true , address=185.167.204.205:4014 , piece_id=S2Z2GPC2KSSPNPQIIDC647OUWOQO4S4L43HLFPRX2RZA546YTWCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.652841735 (271h39m53.24961277s) [noise=true , address=185.167.204.205:4005 , piece_id=3FGBLFPYEJ64ER4DXBG2UHRMGKMK6QVPB3SVR6YH23UYCPCYRICA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.665175985 (271h39m53.261947009s) [noise=true , address=185.167.204.206:4060 , piece_id=JMXC6HFV5PM43TZK4JSDWHJU353UQCRHSCGLQ634EUHNI6JREYCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.691540518 (271h39m53.288311556s) [noise=true , address=185.167.204.206:4069 , piece_id=IOZ7Q7T3YQAVDPV2HVXNWNPLPVFOLLMJVAGFZBII6DTXSEZKDIBA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.698803867 (271h39m53.29557489s) [noise=true , address=89.149.201.147:4021 , piece_id=6JQHBS64NJ56SGNNBEGTCY7HY2ARRCYFVMBUIQSBRFC6C5T5N4GA, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:55.706574733 (271h39m53.303345756s) [noise=true , address=185.167.204.206:4071 , piece_id=IWCIOC2VZCESMXQGM7AYTXQU5KDZVNKTF6IGBBVSY74NU2327QHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.053076996 (271h39m53.649848022s) [noise=true , address=89.149.201.147:4023 , piece_id=I55ZIUTNES24YDFJUAAW6S42Z5THGUVUQUJN3TPJYMWA24RYJG4A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.136475245 (271h39m53.733246296s) [noise=true , address=185.167.204.206:4053 , piece_id=ZPDZKABFYSPAYW5Q7XXRYONB5DYM73SZS7TFGTX3OWOV3D5C3N3A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:56.770416096 (271h39m54.367187105s) [noise=true , address=185.167.204.206:4067 , piece_id=AODZW5EMPKOFIYWJRMGG4DMKH2IQY3P3WRXENTGNCCSGVPS3C3FQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:39:57.930704735 (271h39m55.527475745s) [noise=true , address=185.167.204.206:4051 , piece_id=CXOLWAXBDIOFFJCB5G6XWX6545WQJNPPHWF5G7NGLULZ4ZULOGBQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: <nil>
Mar 17 18:40:54.568915904 (271h40m52.165686941s) [noise=true , address=89.149.201.147:4014 , piece_id=HUUF5LDYOGQWAMRUA2JAHTUM7T77SAIAEQYKFAJIOGUPTQMC4FHQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:55602->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569187426 (271h40m52.165958453s) [noise=true , address=89.149.201.147:4005 , piece_id=WR2LB2S7PSUDTAJE274UUPCDM3RWKIFCJEJDGWAM4RLCXGQF2XCQ, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:40584->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569386427 (271h40m52.166157464s) [noise=true , address=89.149.201.147:4008 , piece_id=IDKXNXMNMODDR7J6I52FFCJLJUBGFLX5QR3QGXTE3QRXMHXAXL5A, seg_pos={0 0}, upload=304281]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:39506->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:40:54.569430305 (271h40m52.166201327s) [seg_pos={0 0}, upload=304281]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:40:54.670141889 (271h40m52.266912915s) [upload=304281]: Done uploading segments...
Mar 17 18:40:54.670203767 (271h40m52.266974801s) [upload=304281]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.105927754s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...X.....................X..X.X.............................] duration:
2.953648653s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:39:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.953771137s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....X.....................X..X.X............................] duration:
2.20655882s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:38:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.206584109s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....X.....................X..X.X...........................] duration:
3.439528432s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:37:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.439575928s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......X.....................X..X.X..........................] duration:
2.5034827s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:37:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.503511448s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......X.....................X..X.X.........................] duration:
2.118998145s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:36:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.119016287s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........X.....................X..X.X........................] duration:
35.266315888s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:36:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 35.266330663s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........X.....................X..X.X.......................] duration:
2.585125907s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:34:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.58514957s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........X.....................X..X.X......................] duration:
2.63195275s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:33:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.631980669s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........X.....................X..X.X.....................] duration:
2.673822867s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:32:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.673852003s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............X.....................X..X.X....................] duration:
3.512311327s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:32:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.512352068s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............X.....................X..X.X...................] duration:
2.154694389s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:31:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.154719578s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............X.....................X..X.X..................] duration:
6.137614633s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:31:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 6.137644086s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............X.....................X..X.X.................] duration:
2.581815205s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:30:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.58184479s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................X.....................X..X.X................] duration:
2.5606848s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:29:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.560711703s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................X.....................X..X.X...............] duration:
43.373013425s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:29:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 43.373068184s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................X.....................X..X.X..............] duration:
2.769799865s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:27:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.769825437s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................X.....................X..X.X.............] duration:
2.535645788s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:26:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.535672462s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................X.....................X..X.X............] duration:
2.569305976s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:25:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.569332473s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.....................X..X.X...........] duration:
2.479090327s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:25:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.47911718s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................X.....................X..X.X..........] duration:
3.404828429s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:25:03 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.404854872s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.....................X..X.X.........] duration:
2.548235432s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:24:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.548252489s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................X.....................X..X.X........] duration:
2.633874642s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:23:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.633896342s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................X.....................X..X.X.......] duration:
2.161553764s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:22:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.161579274s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.....................X..X.X......] duration:
48.757800668s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:22:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 48.757831939s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.....................X..X.X.....] duration:
2.637923333s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:20:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.638019078s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................X.....................X..X.X....] duration:
2.560073087s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:19:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.560098281s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.....................X..X.X...] duration:
3.720730247s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:17:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 3.720765461s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............................X.....................X..X.X..] duration:
2.70181138s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:16:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.701838897s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............................X.....................X..X.X.] duration:
2.68333666s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:16:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.683364924s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................X.....................X..X.X] duration:
1m0.113568534s trace:
https://jaeger.dev.storj.io/trace/616ac9e7e8541c18
FAIL (2026-03-17 18:16:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
ise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977150889 (271h15m15.573921919s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977319581 (271h15m15.574090613s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977561310 (271h15m15.574332343s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.977980309 (271h15m15.57475134s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978467952 (271h15m15.575238981s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978478636 (271h15m15.575249662s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.978931502 (271h15m15.575702525s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979397825 (271h15m15.57616885s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.979864077 (271h15m15.576635113s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.981470555 (271h15m15.578241585s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:17.982374506 (271h15m15.579145534s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Uploading piece...
Mar 17 18:15:18.418129006 (271h15m16.014900043s) [upload=303823]: Next returned nil segment
Mar 17 18:15:18.418144563 (271h15m16.0149156s) [upload=303823]: Waiting for error group managing segments...
Mar 17 18:15:18.611907453 (271h15m16.208678481s) [noise=true , address=89.149.201.147:4002 , piece_id=NKXXXJMI5O4OLDFS4JMTWQCYLGP52ZOBS7LJG6A5SWMWL7MTRGOA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615068962 (271h15m16.211839994s) [noise=true , address=81.171.14.70:4048 , piece_id=S6PTKOBC4NTFLAQYH2KCZFGDCSSXMBRI5XAZKKWIZYLXFDFUHK5Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.615172295 (271h15m16.211943331s) [noise=true , address=89.149.201.147:4019 , piece_id=2WCWH67NFEWEBQQELDVBZB42KSSNGVMZYJECPJ7LQ3OU67JPSR4Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621061965 (271h15m16.217832997s) [noise=true , address=89.149.201.147:4021 , piece_id=DNHGVH27QDAWR3PSIDMKKAU4Z24VOC2PGHQIESICPDMJLV33IMNA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.621621078 (271h15m16.218392092s) [noise=true , address=81.171.14.70:4032 , piece_id=VKZ35AIZ5YQC57JFFHWCHLQG42CD2C43LHONC7Z6C5B5OPASTOXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.624795562 (271h15m16.221566577s) [noise=true , address=81.171.14.70:4041 , piece_id=S24RZI3EVCBONVKQM6UUYDHC6YWAREG4YDLORQN6RUYUZAKSUAHA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.631112220 (271h15m16.227883254s) [noise=true , address=185.167.204.206:4045 , piece_id=D2MJEJNPYQOIRXK44XHVDAES7SPBNUJYQQEE4XWO5QPI324PTZWA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634419436 (271h15m16.231190471s) [noise=true , address=185.167.204.206:4071 , piece_id=WG3X2HQMU57I67DPMKIQJWJQRD4V5XZIQGM7RSZCF2N2GGM4Q54Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.634637850 (271h15m16.231408867s) [noise=true , address=89.149.201.147:4023 , piece_id=WFF3L26MZSE4QQVH46X5DWPWI6WBF4YHC5JJJCZK6KELYCS2HTMQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.635075855 (271h15m16.231846887s) [noise=true , address=185.167.204.206:4062 , piece_id=DFEJCMIKLYRVEWFMJBGFORY5T2WSJTPPQIVOKOVCFZKULPOBYGXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.645639832 (271h15m16.242410862s) [noise=true , address=89.149.201.147:4022 , piece_id=YYUCHJQKDFL764RWI2L6WC6G5B7MF7FHRBPAO4WLJLMKAFQZBIXA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.648377846 (271h15m16.245148875s) [noise=true , address=89.149.201.147:4020 , piece_id=OP5QA5RUMVBJFH7HJSFQAVAV2NATWDUPKWX3NI2TOMMYKKH33DAA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.663561301 (271h15m16.260332337s) [noise=true , address=185.167.204.206:4065 , piece_id=GXRR4S36PZCKHCUF6RATKHTFKGZ7B62K2PQPHMQFBOL6WX4D7EMA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.664123441 (271h15m16.260894469s) [noise=true , address=185.167.204.206:4064 , piece_id=XEDFZF25CKXZWAEKN5GCDJKYIOFX4AEGARO4QNSGDUEQRAH5YWPQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.672535170 (271h15m16.269306215s) [noise=true , address=185.167.204.206:4038 , piece_id=D5QQG5EPEWBWMWHA2ZMBJF2G5DDMVDKL2AXBTURRIGTLTYRDZIDQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.689085603 (271h15m16.285856626s) [noise=true , address=185.167.204.205:4016 , piece_id=BTWB5UOT4TO3E64SW4O2LRFWBOQ4AB2W7WVCKIBJCVXXYVNJEEPA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.691229069 (271h15m16.2880001s) [noise=true , address=185.167.204.205:4010 , piece_id=4QHKLSPFHHHM3QBY7RXDET64PALGIUCW52V47DWPF7GEZSIOUHKA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.706077729 (271h15m16.30284876s) [noise=true , address=185.167.204.206:4068 , piece_id=FIIWKQNRWCMAUI26OJJU6Q4FP6WXMGIQ6XZVATSD2IFJHTWPA4PA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.709727445 (271h15m16.306498475s) [noise=true , address=185.167.204.205:4021 , piece_id=WK6AK4LXAEHSXT4JJ6RF3HGIQ5OYDYEPWE7YBAAPQSRUFUZEMTLA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.711464729 (271h15m16.308235761s) [noise=true , address=185.167.204.205:4030 , piece_id=BILNYMUHFHTTQMFYHSNX5AYBVHSAMIP4V3QIGDIKSONYGWKPGNKQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:18.736938891 (271h15m16.333709928s) [noise=true , address=185.167.204.205:4009 , piece_id=TBBL74VJMLAXVTKKG53MQ4KEI67D3F6WXK6NXOEX4V7EWQH6VVBA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.256275322 (271h15m16.85304635s) [noise=true , address=185.167.204.205:4033 , piece_id=KFG3J4GNVVND4XXOWXATL44C3MW7W5QLA46R6B7YMBLACQAVTTXQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:19.463860153 (271h15m17.060631179s) [noise=true , address=185.167.204.205:4015 , piece_id=7P3C3CF4AXBI2OQHYIBVYO2EN3UV3AGOQ3BVQ6CJ5POO4ML2MA4A, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:20.378348547 (271h15m17.975119578s) [noise=true , address=185.167.204.205:4005 , piece_id=ZGLXKWYLYEEC3T6PSXHCOILSQPOE4T7LUPPKGNZ3C3RKB5O2CJ2Q, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:15:23.820694439 (271h15m21.417465466s) [noise=true , address=185.167.204.206:4051 , piece_id=Y4JBCLXOINSJRAQ2YV6REY3WA32GF3IWAVJHS75UK6NI7X5SY5XQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: <nil>
Mar 17 18:16:17.599289044 (271h16m15.19606008s) [noise=true , address=89.149.201.147:4004 , piece_id=3XES2OT7BNV65U2QPSKGOD4IA5Q4RJUUG7B677B53WJ45O4LNMDA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1u3qrydva66a46yxwwL8KhP22RKxyWH321urJzP6wn7tCiDmhr, address:89.149.201.147:4004): protocol: read tcp 159.223.143.39:49188->89.149.201.147:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599314113 (271h16m15.196085146s) [noise=true , address=89.149.201.147:4008 , piece_id=YVOTEV6V5IFXWXQRL7EADXAZQW3M2TAUWSKLAZTN3TTU45T45IIA, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:41390->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599641867 (271h16m15.196413005s) [noise=true , address=89.149.201.147:4011 , piece_id=667MXA2HOBJOD3TB5FGJXXZVA4T6Y563EDGQVUOW66D2TJH4UOSQ, seg_pos={0 0}, upload=303823]: Done uploading piece. err: ecclient: upload failed (node:12PcxodnQMJERGjvBgnz3iEiC9MseRhMydkCriwGpQKqi6DGFDg, address:89.149.201.147:4011): protocol: read tcp 159.223.143.39:34606->89.149.201.147:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:16:17.599695811 (271h16m15.196466835s) [seg_pos={0 0}, upload=303823]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:16:17.709512090 (271h16m15.306283119s) [upload=303823]: Done uploading segments...
Mar 17 18:16:17.709555478 (271h16m15.306326508s) [upload=303823]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.113662884s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.....................X..X.] duration:
2.579707632s trace:
https://jaeger.dev.storj.io/trace/400f46b9baf786f2
FAIL (2026-03-17 18:14:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
CLRPBRTUY33QHQJAHTHFVPZPESKFHZH2KR5CDA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.817086702 (271h13m18.413857738s) [noise=true , address=81.171.14.70:4026 , piece_id=IN4FZUBXLJ2ORDG4SKIPNSCUZW5AD2LQ3PNZMGXAL56YCYAGO4AQ, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.817591128 (271h13m18.414362163s) [noise=true , address=89.149.201.147:4015 , piece_id=TIYYQMOE4IJXXO6BHILLONQRDTM6KVL63ZH4ECMUKV4PP3RMXYRA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.818176501 (271h13m18.414947533s) [noise=true , address=185.167.204.206:4057 , piece_id=LMK4VFNP7WCUTJA652JAJW263KVT4G5RTSVNEQTMN4VUH6R6OU4Q, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.818718234 (271h13m18.415489268s) [noise=true , address=81.171.14.70:4045 , piece_id=Z6PEGZKZWY46XLLLBYW2HYIEGOYIRII54VDN4X2D4C55I2KROCIQ, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.819337606 (271h13m18.416108639s) [noise=true , address=185.167.204.205:4034 , piece_id=GEDFG4MW3NPX2PTMLQQJM3AWUJTI36QJMPLY5CG2JQOBNCNOZSKA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.819938468 (271h13m18.416709501s) [noise=true , address=89.149.201.147:4009 , piece_id=7EAYZXV3QWW3YDICNEKKLTBG35QWSBV7OXIOGWYZUDSEI63K2P5A, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.820521100 (271h13m18.417292133s) [noise=true , address=185.167.204.205:4031 , piece_id=GPWCTFKVALXKIUS7O7FDCOFBM2TI7DMG2SBYNYAEKNI6WLSZ52JA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.821136264 (271h13m18.417907301s) [noise=true , address=89.149.201.147:4023 , piece_id=U3WCLYXRZ7SN3MRV6PRVMSZSFZ6E6SVFGSZTC5T75NFCFI2DMZSA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.821758435 (271h13m18.41852947s) [noise=true , address=81.171.14.70:4041 , piece_id=UZR5EUV6JFZJRU6BG2CPTXT6FLR3XF6D54QDJXCCN5XG4C7ML73Q, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.822391905 (271h13m18.41916294s) [noise=true , address=185.167.204.206:4051 , piece_id=324KSK5VS5DUFLHTIZYBSXFSVIL3ON7ABZQ5VMOLQ7JAH7LWLBCQ, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:21.240027467 (271h13m18.836798491s) [upload=303788]: Next returned nil segment
Mar 17 18:13:21.240043419 (271h13m18.836814453s) [upload=303788]: Waiting for error group managing segments...
Mar 17 18:13:21.413359927 (271h13m19.010130964s) [noise=true , address=81.171.14.70:4030 , piece_id=C2LXDR2EOGIHTSVOF6OAH3DLPXVFNEEQN3ORRRB7H5YPIJHDOVYA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.419398747 (271h13m19.016169782s) [noise=true , address=81.171.14.70:4026 , piece_id=IN4FZUBXLJ2ORDG4SKIPNSCUZW5AD2LQ3PNZMGXAL56YCYAGO4AQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.422402930 (271h13m19.019173953s) [noise=true , address=81.171.14.70:4045 , piece_id=Z6PEGZKZWY46XLLLBYW2HYIEGOYIRII54VDN4X2D4C55I2KROCIQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.424955162 (271h13m19.021726192s) [noise=true , address=81.171.14.70:4041 , piece_id=UZR5EUV6JFZJRU6BG2CPTXT6FLR3XF6D54QDJXCCN5XG4C7ML73Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.427869735 (271h13m19.024640777s) [noise=true , address=89.149.201.147:4009 , piece_id=7EAYZXV3QWW3YDICNEKKLTBG35QWSBV7OXIOGWYZUDSEI63K2P5A, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.428250337 (271h13m19.025021367s) [noise=true , address=81.171.14.70:4027 , piece_id=XEGP5HOFZGFAXFAP6UQCAJ5BXQTAUH2LHQIGVOQGCFZETSIAHL7A, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.444887865 (271h13m19.041658897s) [noise=true , address=185.167.204.206:4051 , piece_id=324KSK5VS5DUFLHTIZYBSXFSVIL3ON7ABZQ5VMOLQ7JAH7LWLBCQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.451563177 (271h13m19.048334201s) [noise=true , address=81.171.14.70:4040 , piece_id=MWFI33CUT2CATQ2M5XREM3K5KAPXK2MUYDFGFECYC5EJUTG6OYCA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.452876856 (271h13m19.049647883s) [noise=true , address=81.171.14.70:4038 , piece_id=VIBCZZQYQEC5HIC3PP3EIP5LOJW3UPV3Y3LMWXBXGPKUY77JOHBQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.463620252 (271h13m19.060391282s) [noise=true , address=185.167.204.206:4049 , piece_id=XETA4NPDDXAV2A7DC6EL4MI24G3SUKDU634TS2LEUO4IOGI2MFGA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.466305630 (271h13m19.063076659s) [noise=true , address=185.167.204.205:4035 , piece_id=CNBGM37Y4QMSVPUCEZHYBUU2CASD2G54DYFOVC6EVOITDMQKTWTA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.471459051 (271h13m19.068230085s) [noise=true , address=185.167.204.205:4013 , piece_id=USXD7CDTS5TLYPCLRPBRTUY33QHQJAHTHFVPZPESKFHZH2KR5CDA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.483624823 (271h13m19.080395846s) [noise=true , address=185.167.204.205:4002 , piece_id=QNU3P67E5PNDI7K6U36GHR4EDWEBIOS7DKI4G54D4PBDFW4MAUAA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.512282496 (271h13m19.10905352s) [noise=true , address=185.167.204.205:4015 , piece_id=6BNS3B24M4OX7DU2T4ZJJVB5BBDSEK27OFP7WX3NNAMVYXRSURVA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.513707214 (271h13m19.11047825s) [noise=true , address=185.167.204.206:4063 , piece_id=MVKNM4CPS3ILTIGEURSPSYQD6ERYWVUVYJV2DHRGCEBL75HAPIDQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.537083151 (271h13m19.133854184s) [noise=true , address=185.167.204.205:4034 , piece_id=GEDFG4MW3NPX2PTMLQQJM3AWUJTI36QJMPLY5CG2JQOBNCNOZSKA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.537365039 (271h13m19.134136075s) [noise=true , address=185.167.204.205:4031 , piece_id=GPWCTFKVALXKIUS7O7FDCOFBM2TI7DMG2SBYNYAEKNI6WLSZ52JA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.622490453 (271h13m19.219261481s) [noise=true , address=185.167.204.206:4057 , piece_id=LMK4VFNP7WCUTJA652JAJW263KVT4G5RTSVNEQTMN4VUH6R6OU4Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.634565164 (271h13m19.231336194s) [noise=true , address=185.167.204.205:4009 , piece_id=K43QXEU3S3CBYOYEASO5Y3OLXZ6WHEY6QV74632N7GRHZUC7I4PA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.662743414 (271h13m19.259514438s) [noise=true , address=185.167.204.206:4050 , piece_id=FHOWZ53FYEGUQJSA2WP4BZ5ADO5OOOKLUDVX2OY63HPUBX2YPJ5Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.669401403 (271h13m19.266172431s) [noise=true , address=185.167.204.205:4008 , piece_id=CVO4RN5SKDEMSOOLYSLZ4ACU3PZUUHDH3OSOO3CKC3E4BCVWU62Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.921289559 (271h13m19.518060582s) [noise=true , address=81.171.14.70:4028 , piece_id=APVVWZ763MNR5XE3673D4JK6N4GH3D2T2REKD6LPIKJIHRKCYDTQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.939868146 (271h13m19.536639169s) [noise=true , address=81.171.14.70:4042 , piece_id=B7OY5JGAUFNNSO4WKZNLNFJOVYE4AC6XDBUPI5RKIMQLBHNM4RJQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.992781075 (271h13m19.589552105s) [noise=true , address=89.149.201.147:4010 , piece_id=E754ITTXNQPA6HQIDHHQMW3P6UGMGDCCBYTD7F6XH6AVEAHKJP3A, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:14:20.434797033 (271h14m18.031568074s) [noise=true , address=89.149.201.147:4015 , piece_id=TIYYQMOE4IJXXO6BHILLONQRDTM6KVL63ZH4ECMUKV4PP3RMXYRA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 159.223.143.39:59608->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.434935243 (271h14m18.031706274s) [noise=true , address=89.149.201.147:4008 , piece_id=AP5NRL6RF3DNUBR3Z33YYM2O5YKUN3ZCFVASD366IIVH7UU5ZB2Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:45116->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.434962491 (271h14m18.031733512s) [noise=true , address=89.149.201.147:4021 , piece_id=7E32CCADX77MYHOWPTRCQOTWVM2XRUFUP2IQ3YXFVHCSXX4YHJRQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:41636->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.435266346 (271h14m18.032037371s) [noise=true , address=89.149.201.147:4023 , piece_id=U3WCLYXRZ7SN3MRV6PRVMSZSFZ6E6SVFGSZTC5T75NFCFI2DMZSA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:49932->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.435304859 (271h14m18.032075875s) [seg_pos={0 0}, upload=303788]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 18:14:20.536474889 (271h14m18.133245944s) [upload=303788]: Done uploading segments...
Mar 17 18:14:20.536516943 (271h14m18.133287975s) [upload=303788]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.579727798s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..................................X.....................X..X] duration:
1m0.104372049s trace:
https://jaeger.dev.storj.io/trace/400f46b9baf786f2
FAIL (2026-03-17 18:14:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
CLRPBRTUY33QHQJAHTHFVPZPESKFHZH2KR5CDA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.817086702 (271h13m18.413857738s) [noise=true , address=81.171.14.70:4026 , piece_id=IN4FZUBXLJ2ORDG4SKIPNSCUZW5AD2LQ3PNZMGXAL56YCYAGO4AQ, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.817591128 (271h13m18.414362163s) [noise=true , address=89.149.201.147:4015 , piece_id=TIYYQMOE4IJXXO6BHILLONQRDTM6KVL63ZH4ECMUKV4PP3RMXYRA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.818176501 (271h13m18.414947533s) [noise=true , address=185.167.204.206:4057 , piece_id=LMK4VFNP7WCUTJA652JAJW263KVT4G5RTSVNEQTMN4VUH6R6OU4Q, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.818718234 (271h13m18.415489268s) [noise=true , address=81.171.14.70:4045 , piece_id=Z6PEGZKZWY46XLLLBYW2HYIEGOYIRII54VDN4X2D4C55I2KROCIQ, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.819337606 (271h13m18.416108639s) [noise=true , address=185.167.204.205:4034 , piece_id=GEDFG4MW3NPX2PTMLQQJM3AWUJTI36QJMPLY5CG2JQOBNCNOZSKA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.819938468 (271h13m18.416709501s) [noise=true , address=89.149.201.147:4009 , piece_id=7EAYZXV3QWW3YDICNEKKLTBG35QWSBV7OXIOGWYZUDSEI63K2P5A, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.820521100 (271h13m18.417292133s) [noise=true , address=185.167.204.205:4031 , piece_id=GPWCTFKVALXKIUS7O7FDCOFBM2TI7DMG2SBYNYAEKNI6WLSZ52JA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.821136264 (271h13m18.417907301s) [noise=true , address=89.149.201.147:4023 , piece_id=U3WCLYXRZ7SN3MRV6PRVMSZSFZ6E6SVFGSZTC5T75NFCFI2DMZSA, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.821758435 (271h13m18.41852947s) [noise=true , address=81.171.14.70:4041 , piece_id=UZR5EUV6JFZJRU6BG2CPTXT6FLR3XF6D54QDJXCCN5XG4C7ML73Q, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:20.822391905 (271h13m18.41916294s) [noise=true , address=185.167.204.206:4051 , piece_id=324KSK5VS5DUFLHTIZYBSXFSVIL3ON7ABZQ5VMOLQ7JAH7LWLBCQ, seg_pos={0 0}, upload=303788]: Uploading piece...
Mar 17 18:13:21.240027467 (271h13m18.836798491s) [upload=303788]: Next returned nil segment
Mar 17 18:13:21.240043419 (271h13m18.836814453s) [upload=303788]: Waiting for error group managing segments...
Mar 17 18:13:21.413359927 (271h13m19.010130964s) [noise=true , address=81.171.14.70:4030 , piece_id=C2LXDR2EOGIHTSVOF6OAH3DLPXVFNEEQN3ORRRB7H5YPIJHDOVYA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.419398747 (271h13m19.016169782s) [noise=true , address=81.171.14.70:4026 , piece_id=IN4FZUBXLJ2ORDG4SKIPNSCUZW5AD2LQ3PNZMGXAL56YCYAGO4AQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.422402930 (271h13m19.019173953s) [noise=true , address=81.171.14.70:4045 , piece_id=Z6PEGZKZWY46XLLLBYW2HYIEGOYIRII54VDN4X2D4C55I2KROCIQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.424955162 (271h13m19.021726192s) [noise=true , address=81.171.14.70:4041 , piece_id=UZR5EUV6JFZJRU6BG2CPTXT6FLR3XF6D54QDJXCCN5XG4C7ML73Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.427869735 (271h13m19.024640777s) [noise=true , address=89.149.201.147:4009 , piece_id=7EAYZXV3QWW3YDICNEKKLTBG35QWSBV7OXIOGWYZUDSEI63K2P5A, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.428250337 (271h13m19.025021367s) [noise=true , address=81.171.14.70:4027 , piece_id=XEGP5HOFZGFAXFAP6UQCAJ5BXQTAUH2LHQIGVOQGCFZETSIAHL7A, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.444887865 (271h13m19.041658897s) [noise=true , address=185.167.204.206:4051 , piece_id=324KSK5VS5DUFLHTIZYBSXFSVIL3ON7ABZQ5VMOLQ7JAH7LWLBCQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.451563177 (271h13m19.048334201s) [noise=true , address=81.171.14.70:4040 , piece_id=MWFI33CUT2CATQ2M5XREM3K5KAPXK2MUYDFGFECYC5EJUTG6OYCA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.452876856 (271h13m19.049647883s) [noise=true , address=81.171.14.70:4038 , piece_id=VIBCZZQYQEC5HIC3PP3EIP5LOJW3UPV3Y3LMWXBXGPKUY77JOHBQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.463620252 (271h13m19.060391282s) [noise=true , address=185.167.204.206:4049 , piece_id=XETA4NPDDXAV2A7DC6EL4MI24G3SUKDU634TS2LEUO4IOGI2MFGA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.466305630 (271h13m19.063076659s) [noise=true , address=185.167.204.205:4035 , piece_id=CNBGM37Y4QMSVPUCEZHYBUU2CASD2G54DYFOVC6EVOITDMQKTWTA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.471459051 (271h13m19.068230085s) [noise=true , address=185.167.204.205:4013 , piece_id=USXD7CDTS5TLYPCLRPBRTUY33QHQJAHTHFVPZPESKFHZH2KR5CDA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.483624823 (271h13m19.080395846s) [noise=true , address=185.167.204.205:4002 , piece_id=QNU3P67E5PNDI7K6U36GHR4EDWEBIOS7DKI4G54D4PBDFW4MAUAA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.512282496 (271h13m19.10905352s) [noise=true , address=185.167.204.205:4015 , piece_id=6BNS3B24M4OX7DU2T4ZJJVB5BBDSEK27OFP7WX3NNAMVYXRSURVA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.513707214 (271h13m19.11047825s) [noise=true , address=185.167.204.206:4063 , piece_id=MVKNM4CPS3ILTIGEURSPSYQD6ERYWVUVYJV2DHRGCEBL75HAPIDQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.537083151 (271h13m19.133854184s) [noise=true , address=185.167.204.205:4034 , piece_id=GEDFG4MW3NPX2PTMLQQJM3AWUJTI36QJMPLY5CG2JQOBNCNOZSKA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.537365039 (271h13m19.134136075s) [noise=true , address=185.167.204.205:4031 , piece_id=GPWCTFKVALXKIUS7O7FDCOFBM2TI7DMG2SBYNYAEKNI6WLSZ52JA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.622490453 (271h13m19.219261481s) [noise=true , address=185.167.204.206:4057 , piece_id=LMK4VFNP7WCUTJA652JAJW263KVT4G5RTSVNEQTMN4VUH6R6OU4Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.634565164 (271h13m19.231336194s) [noise=true , address=185.167.204.205:4009 , piece_id=K43QXEU3S3CBYOYEASO5Y3OLXZ6WHEY6QV74632N7GRHZUC7I4PA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.662743414 (271h13m19.259514438s) [noise=true , address=185.167.204.206:4050 , piece_id=FHOWZ53FYEGUQJSA2WP4BZ5ADO5OOOKLUDVX2OY63HPUBX2YPJ5Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.669401403 (271h13m19.266172431s) [noise=true , address=185.167.204.205:4008 , piece_id=CVO4RN5SKDEMSOOLYSLZ4ACU3PZUUHDH3OSOO3CKC3E4BCVWU62Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.921289559 (271h13m19.518060582s) [noise=true , address=81.171.14.70:4028 , piece_id=APVVWZ763MNR5XE3673D4JK6N4GH3D2T2REKD6LPIKJIHRKCYDTQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.939868146 (271h13m19.536639169s) [noise=true , address=81.171.14.70:4042 , piece_id=B7OY5JGAUFNNSO4WKZNLNFJOVYE4AC6XDBUPI5RKIMQLBHNM4RJQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:13:21.992781075 (271h13m19.589552105s) [noise=true , address=89.149.201.147:4010 , piece_id=E754ITTXNQPA6HQIDHHQMW3P6UGMGDCCBYTD7F6XH6AVEAHKJP3A, seg_pos={0 0}, upload=303788]: Done uploading piece. err: <nil>
Mar 17 18:14:20.434797033 (271h14m18.031568074s) [noise=true , address=89.149.201.147:4015 , piece_id=TIYYQMOE4IJXXO6BHILLONQRDTM6KVL63ZH4ECMUKV4PP3RMXYRA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:12RbD6M2MHJfxcJXogZG8nUGFmeZjwUQ1auN6KGWJMPTffdK42K, address:89.149.201.147:4015): protocol: read tcp 159.223.143.39:59608->89.149.201.147:4015: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.434935243 (271h14m18.031706274s) [noise=true , address=89.149.201.147:4008 , piece_id=AP5NRL6RF3DNUBR3Z33YYM2O5YKUN3ZCFVASD366IIVH7UU5ZB2Q, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:45116->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.434962491 (271h14m18.031733512s) [noise=true , address=89.149.201.147:4021 , piece_id=7E32CCADX77MYHOWPTRCQOTWVM2XRUFUP2IQ3YXFVHCSXX4YHJRQ, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:41636->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.435266346 (271h14m18.032037371s) [noise=true , address=89.149.201.147:4023 , piece_id=U3WCLYXRZ7SN3MRV6PRVMSZSFZ6E6SVFGSZTC5T75NFCFI2DMZSA, seg_pos={0 0}, upload=303788]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:49932->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:14:20.435304859 (271h14m18.032075875s) [seg_pos={0 0}, upload=303788]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 18:14:20.536474889 (271h14m18.133245944s) [upload=303788]: Done uploading segments...
Mar 17 18:14:20.536516943 (271h14m18.133287975s) [upload=303788]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 1m0.10440761s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.....................X..] duration:
2.741696884s trace:
https://jaeger.dev.storj.io/trace/2eaf637758a28643
FAIL (2026-03-17 18:12:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
BSLDQ76E6HQC5IBZNIOVH3VYBKNH2KWUMRQUEUBQ, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.062134830 (271h10m43.658905865s) [noise=true , address=81.171.14.70:4040 , piece_id=BLXEAMYJTAOZK3F3PHP5SISPP5BKIBO3CMXTCB5BPW2R3FUZWTQQ, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.064895195 (271h10m43.661666242s) [noise=true , address=185.167.204.206:4068 , piece_id=4OUKMMKF66JH7THNNPQNEOBC3NEKKOLQY7NOMA73OHKXXPNVYM6Q, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.067657662 (271h10m43.664428698s) [noise=true , address=81.171.14.70:4025 , piece_id=3IXZGLNLSPH5UTJKB2BDCLF2UD2GISZXJUYJQ2KJUVWJ3ASHTGVA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.070298969 (271h10m43.667070006s) [noise=true , address=185.167.204.206:4049 , piece_id=36CCQ4IBOGVYE3CIDKPZ7YSWMUT7CYAIC4XPPYKUODDPWKTKJ4XA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.072999194 (271h10m43.669770237s) [noise=true , address=89.149.201.147:4019 , piece_id=NDPMUOFQWSNEMW6ZQO36DYW2L7YITGZBM7DONJP6A34DAGEDPU4Q, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.075706546 (271h10m43.672477587s) [noise=true , address=185.167.204.205:4020 , piece_id=KDFTH7PC2EHO7SSI5Z6W37RQNP7SLL7JQEWUDKFAICDMODVWWW7A, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.078336915 (271h10m43.675107951s) [noise=true , address=81.171.14.70:4031 , piece_id=A7RIC3GHAPFSBH3WNIQAZRVPUWLC6DRMX4MVSO6S3OYTBIBJDE5A, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.080927161 (271h10m43.677698198s) [noise=true , address=81.171.14.70:4035 , piece_id=C5CINLTGBG4M2O7C5GK4JRSKKDJXFE25CDDOUMJ2LWYTMKVFSACA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.083971717 (271h10m43.680742745s) [noise=true , address=185.167.204.206:4062 , piece_id=KEWNKKAOJZDYAMALM7MHVB26UTEVFWUUMUV6AHK6ZGDQ5UZSJ7WA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.085990210 (271h10m43.682761244s) [noise=true , address=89.149.201.147:4006 , piece_id=EJTE46JLO6K4XR4LZVNQRDI6LVA25WCD7LGH3QC7BZHXDBI7VHVA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.519896823 (271h10m44.116667847s) [upload=303741]: Next returned nil segment
Mar 17 18:10:46.519912300 (271h10m44.116683325s) [upload=303741]: Waiting for error group managing segments...
Mar 17 18:10:46.694054097 (271h10m44.290825123s) [noise=true , address=81.171.14.70:4040 , piece_id=BLXEAMYJTAOZK3F3PHP5SISPP5BKIBO3CMXTCB5BPW2R3FUZWTQQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.699922554 (271h10m44.296693584s) [noise=true , address=81.171.14.70:4035 , piece_id=C5CINLTGBG4M2O7C5GK4JRSKKDJXFE25CDDOUMJ2LWYTMKVFSACA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.713155700 (271h10m44.309926723s) [noise=true , address=81.171.14.70:4037 , piece_id=5UETMA2RPY4FBSLDQ76E6HQC5IBZNIOVH3VYBKNH2KWUMRQUEUBQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.715353123 (271h10m44.312124144s) [noise=true , address=81.171.14.70:4029 , piece_id=PH7FIL7ORXHULIQD23RXBUPSA3BWWGTZ5R5RUBKMF5WRW3JLAOJA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.722705433 (271h10m44.319476457s) [noise=true , address=81.171.14.70:4030 , piece_id=Z2N33WF7ZXVY2JI6ILQDU3CNQCXEKA2VJUVWIQOWPJNRRNOR2YBQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.734463848 (271h10m44.331234874s) [noise=true , address=81.171.14.70:4031 , piece_id=A7RIC3GHAPFSBH3WNIQAZRVPUWLC6DRMX4MVSO6S3OYTBIBJDE5A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.739571548 (271h10m44.336342572s) [noise=true , address=81.171.14.70:4038 , piece_id=2QKIBYYJCURAFJDHQSNPGWTUHWH7WLDDK6LIX7NVO4XQYINFJRMA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.746659075 (271h10m44.343430099s) [noise=true , address=89.149.201.147:4005 , piece_id=C5AFUMPASNG2EWJPKTSC2IJF2ZWUXC4J2VTOIXOGGUJKXGIRZR2A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.749025157 (271h10m44.345796167s) [noise=true , address=185.167.204.206:4068 , piece_id=4OUKMMKF66JH7THNNPQNEOBC3NEKKOLQY7NOMA73OHKXXPNVYM6Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.755674995 (271h10m44.352446024s) [noise=true , address=89.149.201.147:4018 , piece_id=MGGKTKUYCDN4LPWR2QXM66AQKER5Q2H72OTBSX6P4IZUCOOOHEGA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.759245636 (271h10m44.356016673s) [noise=true , address=185.167.204.205:4033 , piece_id=JQHYZSRDXTQF2I4SN7JKD7Y2R56W4TTQZVSJNLNLA5JGVHNDB27Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.761153973 (271h10m44.357924987s) [noise=true , address=185.167.204.205:4031 , piece_id=AUKOBQJMXX3X6SYZ65MG7E2ZHWLENAMSMSQW7JNIJICKFPBMLXLA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.764182957 (271h10m44.36095398s) [noise=true , address=185.167.204.205:4020 , piece_id=KDFTH7PC2EHO7SSI5Z6W37RQNP7SLL7JQEWUDKFAICDMODVWWW7A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.766244064 (271h10m44.36301509s) [noise=true , address=185.167.204.205:4019 , piece_id=ZUHFWSYE4NVDSHIHILU36OWBJ4TWEONKNUFM4ZWSLD4RHYBRPUTQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.821281008 (271h10m44.418052034s) [noise=true , address=185.167.204.206:4037 , piece_id=AMON2V74RDYTY5I7LFV6WHXMCOK67URD7B2WZUPW4C7QR2PIJYZA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.831927217 (271h10m44.42869824s) [noise=true , address=185.167.204.205:4016 , piece_id=TCWPBIXPKSSJMOJNR75K5OSP4EZI7IUYYBKCDIZG4YUQ2RRBT6VA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.833732892 (271h10m44.430503917s) [noise=true , address=185.167.204.206:4049 , piece_id=36CCQ4IBOGVYE3CIDKPZ7YSWMUT7CYAIC4XPPYKUODDPWKTKJ4XA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.005730184 (271h10m44.602501207s) [noise=true , address=185.167.204.206:4062 , piece_id=KEWNKKAOJZDYAMALM7MHVB26UTEVFWUUMUV6AHK6ZGDQ5UZSJ7WA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.160927418 (271h10m44.757698431s) [noise=true , address=81.171.14.70:4025 , piece_id=3IXZGLNLSPH5UTJKB2BDCLF2UD2GISZXJUYJQ2KJUVWJ3ASHTGVA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.210047704 (271h10m44.806818744s) [noise=true , address=81.171.14.70:4045 , piece_id=YN2RLNOXFCSNKFQD42QRX4RR6TOXNMA6SNGD235UWP5GFGUBGAUA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.223502541 (271h10m44.820273565s) [noise=true , address=81.171.14.70:4027 , piece_id=ZOMSQW5E6WBWX6YW3RKFB3IHFHEYIG6MLFYXAGUPXBH3RZ6HMPLQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.233949534 (271h10m44.830720557s) [noise=true , address=89.149.201.147:4006 , piece_id=EJTE46JLO6K4XR4LZVNQRDI6LVA25WCD7LGH3QC7BZHXDBI7VHVA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.253543688 (271h10m44.850314711s) [noise=true , address=89.149.201.147:4001 , piece_id=W2I7JVKV7ORABSSJGP3AJDVHXXQV7ASIH63YFP65YYZHU5J3WODQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:49.260539957 (271h10m46.857310983s) [noise=true , address=185.167.204.206:4059 , piece_id=575O4H73LUEMLD53IIRCQX7VZIUGOYDLKCYZJ7SBP6HIF2HYD77Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:11:45.616068073 (271h11m43.212839096s) [noise=true , address=89.149.201.147:4014 , piece_id=AWSBRE66UVZ7ODI3H4B6M7GEB5IYI6VDMBAXGMYOPXNDK5T25X2A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:41712->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616178025 (271h11m43.212949097s) [noise=true , address=89.149.201.147:4008 , piece_id=GV5Q3SQ7S7RZS25GRJCL4HR4N2WXBJETODL7CI5UPOXZPWV77SCQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:58316->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616286281 (271h11m43.213057304s) [noise=true , address=89.149.201.147:4012 , piece_id=FWDL7SSEPMZWZMJMYK3ZN5ZISD5OPDFAUOZLNIROIWTBFKQCGERQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:52402->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616338011 (271h11m43.213109034s) [noise=true , address=89.149.201.147:4019 , piece_id=NDPMUOFQWSNEMW6ZQO36DYW2L7YITGZBM7DONJP6A34DAGEDPU4Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:53104->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616379535 (271h11m43.213150544s) [seg_pos={0 0}, upload=303741]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 18:11:45.717080263 (271h11m43.313851285s) [upload=303741]: Done uploading segments...
Mar 17 18:11:45.717113447 (271h11m43.313884473s) [upload=303741]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.741725402s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [X...................................X.....................X.] duration:
8.922210479s trace:
https://jaeger.dev.storj.io/trace/2eaf637758a28643
FAIL (2026-03-17 18:11:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
BSLDQ76E6HQC5IBZNIOVH3VYBKNH2KWUMRQUEUBQ, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.062134830 (271h10m43.658905865s) [noise=true , address=81.171.14.70:4040 , piece_id=BLXEAMYJTAOZK3F3PHP5SISPP5BKIBO3CMXTCB5BPW2R3FUZWTQQ, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.064895195 (271h10m43.661666242s) [noise=true , address=185.167.204.206:4068 , piece_id=4OUKMMKF66JH7THNNPQNEOBC3NEKKOLQY7NOMA73OHKXXPNVYM6Q, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.067657662 (271h10m43.664428698s) [noise=true , address=81.171.14.70:4025 , piece_id=3IXZGLNLSPH5UTJKB2BDCLF2UD2GISZXJUYJQ2KJUVWJ3ASHTGVA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.070298969 (271h10m43.667070006s) [noise=true , address=185.167.204.206:4049 , piece_id=36CCQ4IBOGVYE3CIDKPZ7YSWMUT7CYAIC4XPPYKUODDPWKTKJ4XA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.072999194 (271h10m43.669770237s) [noise=true , address=89.149.201.147:4019 , piece_id=NDPMUOFQWSNEMW6ZQO36DYW2L7YITGZBM7DONJP6A34DAGEDPU4Q, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.075706546 (271h10m43.672477587s) [noise=true , address=185.167.204.205:4020 , piece_id=KDFTH7PC2EHO7SSI5Z6W37RQNP7SLL7JQEWUDKFAICDMODVWWW7A, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.078336915 (271h10m43.675107951s) [noise=true , address=81.171.14.70:4031 , piece_id=A7RIC3GHAPFSBH3WNIQAZRVPUWLC6DRMX4MVSO6S3OYTBIBJDE5A, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.080927161 (271h10m43.677698198s) [noise=true , address=81.171.14.70:4035 , piece_id=C5CINLTGBG4M2O7C5GK4JRSKKDJXFE25CDDOUMJ2LWYTMKVFSACA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.083971717 (271h10m43.680742745s) [noise=true , address=185.167.204.206:4062 , piece_id=KEWNKKAOJZDYAMALM7MHVB26UTEVFWUUMUV6AHK6ZGDQ5UZSJ7WA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.085990210 (271h10m43.682761244s) [noise=true , address=89.149.201.147:4006 , piece_id=EJTE46JLO6K4XR4LZVNQRDI6LVA25WCD7LGH3QC7BZHXDBI7VHVA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.519896823 (271h10m44.116667847s) [upload=303741]: Next returned nil segment
Mar 17 18:10:46.519912300 (271h10m44.116683325s) [upload=303741]: Waiting for error group managing segments...
Mar 17 18:10:46.694054097 (271h10m44.290825123s) [noise=true , address=81.171.14.70:4040 , piece_id=BLXEAMYJTAOZK3F3PHP5SISPP5BKIBO3CMXTCB5BPW2R3FUZWTQQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.699922554 (271h10m44.296693584s) [noise=true , address=81.171.14.70:4035 , piece_id=C5CINLTGBG4M2O7C5GK4JRSKKDJXFE25CDDOUMJ2LWYTMKVFSACA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.713155700 (271h10m44.309926723s) [noise=true , address=81.171.14.70:4037 , piece_id=5UETMA2RPY4FBSLDQ76E6HQC5IBZNIOVH3VYBKNH2KWUMRQUEUBQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.715353123 (271h10m44.312124144s) [noise=true , address=81.171.14.70:4029 , piece_id=PH7FIL7ORXHULIQD23RXBUPSA3BWWGTZ5R5RUBKMF5WRW3JLAOJA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.722705433 (271h10m44.319476457s) [noise=true , address=81.171.14.70:4030 , piece_id=Z2N33WF7ZXVY2JI6ILQDU3CNQCXEKA2VJUVWIQOWPJNRRNOR2YBQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.734463848 (271h10m44.331234874s) [noise=true , address=81.171.14.70:4031 , piece_id=A7RIC3GHAPFSBH3WNIQAZRVPUWLC6DRMX4MVSO6S3OYTBIBJDE5A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.739571548 (271h10m44.336342572s) [noise=true , address=81.171.14.70:4038 , piece_id=2QKIBYYJCURAFJDHQSNPGWTUHWH7WLDDK6LIX7NVO4XQYINFJRMA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.746659075 (271h10m44.343430099s) [noise=true , address=89.149.201.147:4005 , piece_id=C5AFUMPASNG2EWJPKTSC2IJF2ZWUXC4J2VTOIXOGGUJKXGIRZR2A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.749025157 (271h10m44.345796167s) [noise=true , address=185.167.204.206:4068 , piece_id=4OUKMMKF66JH7THNNPQNEOBC3NEKKOLQY7NOMA73OHKXXPNVYM6Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.755674995 (271h10m44.352446024s) [noise=true , address=89.149.201.147:4018 , piece_id=MGGKTKUYCDN4LPWR2QXM66AQKER5Q2H72OTBSX6P4IZUCOOOHEGA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.759245636 (271h10m44.356016673s) [noise=true , address=185.167.204.205:4033 , piece_id=JQHYZSRDXTQF2I4SN7JKD7Y2R56W4TTQZVSJNLNLA5JGVHNDB27Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.761153973 (271h10m44.357924987s) [noise=true , address=185.167.204.205:4031 , piece_id=AUKOBQJMXX3X6SYZ65MG7E2ZHWLENAMSMSQW7JNIJICKFPBMLXLA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.764182957 (271h10m44.36095398s) [noise=true , address=185.167.204.205:4020 , piece_id=KDFTH7PC2EHO7SSI5Z6W37RQNP7SLL7JQEWUDKFAICDMODVWWW7A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.766244064 (271h10m44.36301509s) [noise=true , address=185.167.204.205:4019 , piece_id=ZUHFWSYE4NVDSHIHILU36OWBJ4TWEONKNUFM4ZWSLD4RHYBRPUTQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.821281008 (271h10m44.418052034s) [noise=true , address=185.167.204.206:4037 , piece_id=AMON2V74RDYTY5I7LFV6WHXMCOK67URD7B2WZUPW4C7QR2PIJYZA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.831927217 (271h10m44.42869824s) [noise=true , address=185.167.204.205:4016 , piece_id=TCWPBIXPKSSJMOJNR75K5OSP4EZI7IUYYBKCDIZG4YUQ2RRBT6VA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.833732892 (271h10m44.430503917s) [noise=true , address=185.167.204.206:4049 , piece_id=36CCQ4IBOGVYE3CIDKPZ7YSWMUT7CYAIC4XPPYKUODDPWKTKJ4XA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.005730184 (271h10m44.602501207s) [noise=true , address=185.167.204.206:4062 , piece_id=KEWNKKAOJZDYAMALM7MHVB26UTEVFWUUMUV6AHK6ZGDQ5UZSJ7WA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.160927418 (271h10m44.757698431s) [noise=true , address=81.171.14.70:4025 , piece_id=3IXZGLNLSPH5UTJKB2BDCLF2UD2GISZXJUYJQ2KJUVWJ3ASHTGVA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.210047704 (271h10m44.806818744s) [noise=true , address=81.171.14.70:4045 , piece_id=YN2RLNOXFCSNKFQD42QRX4RR6TOXNMA6SNGD235UWP5GFGUBGAUA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.223502541 (271h10m44.820273565s) [noise=true , address=81.171.14.70:4027 , piece_id=ZOMSQW5E6WBWX6YW3RKFB3IHFHEYIG6MLFYXAGUPXBH3RZ6HMPLQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.233949534 (271h10m44.830720557s) [noise=true , address=89.149.201.147:4006 , piece_id=EJTE46JLO6K4XR4LZVNQRDI6LVA25WCD7LGH3QC7BZHXDBI7VHVA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.253543688 (271h10m44.850314711s) [noise=true , address=89.149.201.147:4001 , piece_id=W2I7JVKV7ORABSSJGP3AJDVHXXQV7ASIH63YFP65YYZHU5J3WODQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:49.260539957 (271h10m46.857310983s) [noise=true , address=185.167.204.206:4059 , piece_id=575O4H73LUEMLD53IIRCQX7VZIUGOYDLKCYZJ7SBP6HIF2HYD77Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:11:45.616068073 (271h11m43.212839096s) [noise=true , address=89.149.201.147:4014 , piece_id=AWSBRE66UVZ7ODI3H4B6M7GEB5IYI6VDMBAXGMYOPXNDK5T25X2A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:41712->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616178025 (271h11m43.212949097s) [noise=true , address=89.149.201.147:4008 , piece_id=GV5Q3SQ7S7RZS25GRJCL4HR4N2WXBJETODL7CI5UPOXZPWV77SCQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:58316->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616286281 (271h11m43.213057304s) [noise=true , address=89.149.201.147:4012 , piece_id=FWDL7SSEPMZWZMJMYK3ZN5ZISD5OPDFAUOZLNIROIWTBFKQCGERQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:52402->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616338011 (271h11m43.213109034s) [noise=true , address=89.149.201.147:4019 , piece_id=NDPMUOFQWSNEMW6ZQO36DYW2L7YITGZBM7DONJP6A34DAGEDPU4Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:53104->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616379535 (271h11m43.213150544s) [seg_pos={0 0}, upload=303741]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 18:11:45.717080263 (271h11m43.313851285s) [upload=303741]: Done uploading segments...
Mar 17 18:11:45.717113447 (271h11m43.313884473s) [upload=303741]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 8.92222491s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.X...................................X.....................X] duration:
1m0.103614368s trace:
https://jaeger.dev.storj.io/trace/2eaf637758a28643
FAIL (2026-03-17 18:11:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
BSLDQ76E6HQC5IBZNIOVH3VYBKNH2KWUMRQUEUBQ, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.062134830 (271h10m43.658905865s) [noise=true , address=81.171.14.70:4040 , piece_id=BLXEAMYJTAOZK3F3PHP5SISPP5BKIBO3CMXTCB5BPW2R3FUZWTQQ, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.064895195 (271h10m43.661666242s) [noise=true , address=185.167.204.206:4068 , piece_id=4OUKMMKF66JH7THNNPQNEOBC3NEKKOLQY7NOMA73OHKXXPNVYM6Q, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.067657662 (271h10m43.664428698s) [noise=true , address=81.171.14.70:4025 , piece_id=3IXZGLNLSPH5UTJKB2BDCLF2UD2GISZXJUYJQ2KJUVWJ3ASHTGVA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.070298969 (271h10m43.667070006s) [noise=true , address=185.167.204.206:4049 , piece_id=36CCQ4IBOGVYE3CIDKPZ7YSWMUT7CYAIC4XPPYKUODDPWKTKJ4XA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.072999194 (271h10m43.669770237s) [noise=true , address=89.149.201.147:4019 , piece_id=NDPMUOFQWSNEMW6ZQO36DYW2L7YITGZBM7DONJP6A34DAGEDPU4Q, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.075706546 (271h10m43.672477587s) [noise=true , address=185.167.204.205:4020 , piece_id=KDFTH7PC2EHO7SSI5Z6W37RQNP7SLL7JQEWUDKFAICDMODVWWW7A, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.078336915 (271h10m43.675107951s) [noise=true , address=81.171.14.70:4031 , piece_id=A7RIC3GHAPFSBH3WNIQAZRVPUWLC6DRMX4MVSO6S3OYTBIBJDE5A, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.080927161 (271h10m43.677698198s) [noise=true , address=81.171.14.70:4035 , piece_id=C5CINLTGBG4M2O7C5GK4JRSKKDJXFE25CDDOUMJ2LWYTMKVFSACA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.083971717 (271h10m43.680742745s) [noise=true , address=185.167.204.206:4062 , piece_id=KEWNKKAOJZDYAMALM7MHVB26UTEVFWUUMUV6AHK6ZGDQ5UZSJ7WA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.085990210 (271h10m43.682761244s) [noise=true , address=89.149.201.147:4006 , piece_id=EJTE46JLO6K4XR4LZVNQRDI6LVA25WCD7LGH3QC7BZHXDBI7VHVA, seg_pos={0 0}, upload=303741]: Uploading piece...
Mar 17 18:10:46.519896823 (271h10m44.116667847s) [upload=303741]: Next returned nil segment
Mar 17 18:10:46.519912300 (271h10m44.116683325s) [upload=303741]: Waiting for error group managing segments...
Mar 17 18:10:46.694054097 (271h10m44.290825123s) [noise=true , address=81.171.14.70:4040 , piece_id=BLXEAMYJTAOZK3F3PHP5SISPP5BKIBO3CMXTCB5BPW2R3FUZWTQQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.699922554 (271h10m44.296693584s) [noise=true , address=81.171.14.70:4035 , piece_id=C5CINLTGBG4M2O7C5GK4JRSKKDJXFE25CDDOUMJ2LWYTMKVFSACA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.713155700 (271h10m44.309926723s) [noise=true , address=81.171.14.70:4037 , piece_id=5UETMA2RPY4FBSLDQ76E6HQC5IBZNIOVH3VYBKNH2KWUMRQUEUBQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.715353123 (271h10m44.312124144s) [noise=true , address=81.171.14.70:4029 , piece_id=PH7FIL7ORXHULIQD23RXBUPSA3BWWGTZ5R5RUBKMF5WRW3JLAOJA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.722705433 (271h10m44.319476457s) [noise=true , address=81.171.14.70:4030 , piece_id=Z2N33WF7ZXVY2JI6ILQDU3CNQCXEKA2VJUVWIQOWPJNRRNOR2YBQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.734463848 (271h10m44.331234874s) [noise=true , address=81.171.14.70:4031 , piece_id=A7RIC3GHAPFSBH3WNIQAZRVPUWLC6DRMX4MVSO6S3OYTBIBJDE5A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.739571548 (271h10m44.336342572s) [noise=true , address=81.171.14.70:4038 , piece_id=2QKIBYYJCURAFJDHQSNPGWTUHWH7WLDDK6LIX7NVO4XQYINFJRMA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.746659075 (271h10m44.343430099s) [noise=true , address=89.149.201.147:4005 , piece_id=C5AFUMPASNG2EWJPKTSC2IJF2ZWUXC4J2VTOIXOGGUJKXGIRZR2A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.749025157 (271h10m44.345796167s) [noise=true , address=185.167.204.206:4068 , piece_id=4OUKMMKF66JH7THNNPQNEOBC3NEKKOLQY7NOMA73OHKXXPNVYM6Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.755674995 (271h10m44.352446024s) [noise=true , address=89.149.201.147:4018 , piece_id=MGGKTKUYCDN4LPWR2QXM66AQKER5Q2H72OTBSX6P4IZUCOOOHEGA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.759245636 (271h10m44.356016673s) [noise=true , address=185.167.204.205:4033 , piece_id=JQHYZSRDXTQF2I4SN7JKD7Y2R56W4TTQZVSJNLNLA5JGVHNDB27Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.761153973 (271h10m44.357924987s) [noise=true , address=185.167.204.205:4031 , piece_id=AUKOBQJMXX3X6SYZ65MG7E2ZHWLENAMSMSQW7JNIJICKFPBMLXLA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.764182957 (271h10m44.36095398s) [noise=true , address=185.167.204.205:4020 , piece_id=KDFTH7PC2EHO7SSI5Z6W37RQNP7SLL7JQEWUDKFAICDMODVWWW7A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.766244064 (271h10m44.36301509s) [noise=true , address=185.167.204.205:4019 , piece_id=ZUHFWSYE4NVDSHIHILU36OWBJ4TWEONKNUFM4ZWSLD4RHYBRPUTQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.821281008 (271h10m44.418052034s) [noise=true , address=185.167.204.206:4037 , piece_id=AMON2V74RDYTY5I7LFV6WHXMCOK67URD7B2WZUPW4C7QR2PIJYZA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.831927217 (271h10m44.42869824s) [noise=true , address=185.167.204.205:4016 , piece_id=TCWPBIXPKSSJMOJNR75K5OSP4EZI7IUYYBKCDIZG4YUQ2RRBT6VA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:46.833732892 (271h10m44.430503917s) [noise=true , address=185.167.204.206:4049 , piece_id=36CCQ4IBOGVYE3CIDKPZ7YSWMUT7CYAIC4XPPYKUODDPWKTKJ4XA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.005730184 (271h10m44.602501207s) [noise=true , address=185.167.204.206:4062 , piece_id=KEWNKKAOJZDYAMALM7MHVB26UTEVFWUUMUV6AHK6ZGDQ5UZSJ7WA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.160927418 (271h10m44.757698431s) [noise=true , address=81.171.14.70:4025 , piece_id=3IXZGLNLSPH5UTJKB2BDCLF2UD2GISZXJUYJQ2KJUVWJ3ASHTGVA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.210047704 (271h10m44.806818744s) [noise=true , address=81.171.14.70:4045 , piece_id=YN2RLNOXFCSNKFQD42QRX4RR6TOXNMA6SNGD235UWP5GFGUBGAUA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.223502541 (271h10m44.820273565s) [noise=true , address=81.171.14.70:4027 , piece_id=ZOMSQW5E6WBWX6YW3RKFB3IHFHEYIG6MLFYXAGUPXBH3RZ6HMPLQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.233949534 (271h10m44.830720557s) [noise=true , address=89.149.201.147:4006 , piece_id=EJTE46JLO6K4XR4LZVNQRDI6LVA25WCD7LGH3QC7BZHXDBI7VHVA, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:47.253543688 (271h10m44.850314711s) [noise=true , address=89.149.201.147:4001 , piece_id=W2I7JVKV7ORABSSJGP3AJDVHXXQV7ASIH63YFP65YYZHU5J3WODQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:10:49.260539957 (271h10m46.857310983s) [noise=true , address=185.167.204.206:4059 , piece_id=575O4H73LUEMLD53IIRCQX7VZIUGOYDLKCYZJ7SBP6HIF2HYD77Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: <nil>
Mar 17 18:11:45.616068073 (271h11m43.212839096s) [noise=true , address=89.149.201.147:4014 , piece_id=AWSBRE66UVZ7ODI3H4B6M7GEB5IYI6VDMBAXGMYOPXNDK5T25X2A, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:41712->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616178025 (271h11m43.212949097s) [noise=true , address=89.149.201.147:4008 , piece_id=GV5Q3SQ7S7RZS25GRJCL4HR4N2WXBJETODL7CI5UPOXZPWV77SCQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1QN8VP6o7qGw9Dd8EafU9xe7s7Cuf1FyqPMbnRaznrfPxfEUUn, address:89.149.201.147:4008): protocol: read tcp 159.223.143.39:58316->89.149.201.147:4008: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616286281 (271h11m43.213057304s) [noise=true , address=89.149.201.147:4012 , piece_id=FWDL7SSEPMZWZMJMYK3ZN5ZISD5OPDFAUOZLNIROIWTBFKQCGERQ, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:1hJ5jT6S2d3DJe9DoVDjHMkpwSTpeyTMyNLaK8Pk8SWcUVRKnv, address:89.149.201.147:4012): protocol: read tcp 159.223.143.39:52402->89.149.201.147:4012: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616338011 (271h11m43.213109034s) [noise=true , address=89.149.201.147:4019 , piece_id=NDPMUOFQWSNEMW6ZQO36DYW2L7YITGZBM7DONJP6A34DAGEDPU4Q, seg_pos={0 0}, upload=303741]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:53104->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:11:45.616379535 (271h11m43.213150544s) [seg_pos={0 0}, upload=303741]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 18:11:45.717080263 (271h11m43.313851285s) [upload=303741]: Done uploading segments...
Mar 17 18:11:45.717113447 (271h11m43.313884473s) [upload=303741]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 1m0.103641986s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..X...................................X.....................] duration:
4.910184424s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:09:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 4.910215638s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...X...................................X....................] duration:
9.704875151s trace:
https://jaeger.dev.storj.io/trace/6b7458c3cfe63bd3
FAIL (2026-03-17 18:08:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
HH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850070305 (270h52m21.446841335s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.850759644 (270h52m21.447530677s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.851594943 (270h52m21.448365976s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854401368 (270h52m21.451172453s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.854887780 (270h52m21.451658791s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855556222 (270h52m21.452327252s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.855795778 (270h52m21.452566795s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.856614375 (270h52m21.453385508s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857192561 (270h52m21.453963594s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:23.857792007 (270h52m21.454563039s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Uploading piece...
Mar 17 17:52:24.283453770 (270h52m21.880224782s) [upload=303407]: Next returned nil segment
Mar 17 17:52:24.283490412 (270h52m21.880261439s) [upload=303407]: Waiting for error group managing segments...
Mar 17 17:52:24.480387862 (270h52m22.077159156s) [noise=true , address=81.171.14.70:4032 , piece_id=S2MG6EXUAVSVEKSHCH5Y6RXSD7XCPDYELVXCRENQR4U746WIZXCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.496126179 (270h52m22.092897207s) [noise=true , address=81.171.14.70:4040 , piece_id=O657K2CNHQ7OXNDFJFYSE3W4JVPBOCDLDTVVDBOEZT3UAPC26OHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.498707542 (270h52m22.095478567s) [noise=true , address=185.167.204.205:4009 , piece_id=HRLFYYWKCT6WVISPPNZRYWT3MQGK6WBJEJ2HQRP6GW3JAGLYFBWQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.502548331 (270h52m22.099319366s) [noise=true , address=81.171.14.70:4031 , piece_id=4OIQ3Z3P2NADYFDWNZTC2QZMGASYUR7TQFWUA3ZJ7QCNJFTWCKMQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.507348108 (270h52m22.10411914s) [noise=true , address=185.167.204.206:4070 , piece_id=QGGNUTI5OMTWLDVVV3MYR6ARL47YJ5PFSI7QDPYLOIXUI5TEEGCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.517434838 (270h52m22.114205875s) [noise=true , address=81.171.14.70:4026 , piece_id=W46UJJAXZBE5A6HCROAGVILCJDK3F4SVEUOJWU5I6MDMQTBQOT4Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.519484527 (270h52m22.116255568s) [noise=true , address=89.149.201.147:4019 , piece_id=VLY2VC4ODI6K4LSHFI3NHHDZZOYORKEXPNFBSNYVUS4BQZWJR6WQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.525590499 (270h52m22.122361534s) [noise=true , address=185.167.204.206:4064 , piece_id=WLW5CEICS4L6SB5D3VTSNUKMTYI6ESGUTMWABZREYTO7FKQHR24Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.526104509 (270h52m22.122875534s) [noise=true , address=185.167.204.206:4069 , piece_id=U4FYXYKQLLZ3RGJSHIKL6PE4OEDPYZ6JMAAOUGBI4Q63LE3MGIRA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.541279225 (270h52m22.138050236s) [noise=true , address=185.167.204.206:4052 , piece_id=3KP5IJBT4C7POSSXZFH2GIVR5PNEQCQXM666752KWVABGWEXBRNA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.556656235 (270h52m22.153427256s) [noise=true , address=185.167.204.206:4047 , piece_id=VDZEWQC5ZJBR7HGCVK5K7YJQGA3CHTXXJHIDQ3MWJYSJFHE6CMGQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.564515190 (270h52m22.161286218s) [noise=true , address=185.167.204.205:4013 , piece_id=UEDRMETA67AXXYN4ITFMOOIFCEXBG5U6A27RF6TJTHXGVHA5BBIA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.566845046 (270h52m22.16361607s) [noise=true , address=185.167.204.206:4041 , piece_id=3MUIBI5IQNLZAMWVPVLGPWQBCGBFRHO3UY72KFJCY4E6J4RHOKCA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.589859489 (270h52m22.186630518s) [noise=true , address=185.167.204.206:4067 , piece_id=GWCTCP6EZBATDKD4JOI74LYCEQWEVJLHE6ZBS2YAHMUNVE7CKNZA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.594147745 (270h52m22.19091878s) [noise=true , address=185.167.204.205:4018 , piece_id=PPJAGQI6BBVYTFIKO2HTPMZLL6WU4RAGQVTPRUMZ4T7YLWRVOOSA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.620641654 (270h52m22.217412664s) [noise=true , address=89.149.201.147:4011 , piece_id=LT2TKWXIHAD3AEEJFYDCMGJISBH5Z4HEAQJTJ76N7H64DFBRSVEQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.626348665 (270h52m22.223119696s) [noise=true , address=185.167.204.206:4056 , piece_id=RKJ7FM3CC47KHH76KYCRCBS44MFPKOG764A3KSBIQE6S72FUTA2Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.939658948 (270h52m22.536429978s) [noise=true , address=81.171.14.70:4045 , piece_id=3URVMH7TQAO4TA4OK2LRTLV4MMAK4S2IEXZMDHLEWEB66W6PWVZQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.945290501 (270h52m22.542061531s) [noise=true , address=81.171.14.70:4027 , piece_id=U2UHJUN6AQIGHQCFKNA5CVOIIPPFW3JN6EW227JAGKNP4PL2LM4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:24.969012496 (270h52m22.565783509s) [noise=true , address=185.167.204.206:4051 , piece_id=OK76QC77BADCJCKJYH56FKKIX2PRODTSTPGC5XIR6NSB345HDRTQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.008705972 (270h52m22.605476989s) [noise=true , address=89.149.201.147:4016 , piece_id=FZUVD3FCFFDMWEW6URYPEAXPB4FCRNGBY3WGQWNB5O72A5OTYYHA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:25.026427914 (270h52m22.623198943s) [noise=true , address=89.149.201.147:4022 , piece_id=3BQ3VFEPBNIEF26GCYK2TXDYOKYPTDSQYRBVTSOE7NPEVDNP5FKA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:28.064406121 (270h52m25.661177145s) [noise=true , address=185.167.204.206:4066 , piece_id=WEDZEB5WD46NLMSNEYFEY4RIHHISFFOONDWZYTLZR6J6CF2NRDHQ, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:52:30.775162799 (270h52m28.37193383s) [noise=true , address=185.167.204.205:4014 , piece_id=EBHJ7DA3UNQGBULDOWAJLXEXSS3U65B36CT5XHGN2RDYDCO5UG3A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: <nil>
Mar 17 17:53:23.427187250 (270h53m21.023958283s) [noise=true , address=89.149.201.147:4014 , piece_id=VJZ5HO7MHH4LDRUHRRPSB3HQIYC5IBIGI4GZQOGNSCCD7JL32LBA, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:49922->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427377383 (270h53m21.024148412s) [noise=true , address=89.149.201.147:4010 , piece_id=RPUXBOCNQWKJ53RSLPZUXBL5YSZBUYS2LWEAVWTKGKETZ7427K4A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:1P9roAnE3zK4HaPFarGVAb8L3EfByGr22ufkLcGUKBeF9SqBA9, address:89.149.201.147:4010): protocol: read tcp 159.223.143.39:50728->89.149.201.147:4010: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427408136 (270h53m21.024179166s) [noise=true , address=89.149.201.147:4002 , piece_id=ZTCF3JQDTLFPWZTUBMGXKUXI2V27JKFGR7T3BDOC2WSXJ2WN5H7Q, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:34238->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427566822 (270h53m21.024337845s) [noise=true , address=89.149.201.147:4021 , piece_id=ZYTEU46DT4CDXUADMTJ3LYJC62ZJB6FILLG2XKS6I5N5WGBSPY2A, seg_pos={0 0}, upload=303407]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:36802->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 17:53:23.427592497 (270h53m21.024363512s) [seg_pos={0 0}, upload=303407]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 17 17:53:23.536289730 (270h53m21.133060752s) [upload=303407]: Done uploading segments...
Mar 17 17:53:23.536326949 (270h53m21.133097982s) [upload=303407]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 9.704896944s
core
uplink
eu-select-1
eu1-placement-15
|