Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.58976061s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:26:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.589776745s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.534703568s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:25:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.53473002s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.720671516s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:24:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.7207029s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [X...X.......................................................] duration:
2.178458932s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:23:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.178480651s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.X...X......................................................] duration:
2.523056882s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:22:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.52308349s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..X...X.....................................................] duration:
2.55044475s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:22:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.550489357s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...X...X....................................................] duration:
2.094225166s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:21:33 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.094256175s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....X...X...................................................] duration:
2.283410084s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:21:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.283440782s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....X...X..................................................] duration:
2.19989765s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:20:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.199928657s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......X...X.................................................] duration:
2.475065369s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:20:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.475101256s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.......X...X................................................] duration:
2.123405965s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:18:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.123432072s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [........X...X...............................................] duration:
2.17070835s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:18:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.170841434s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.........X...X..............................................] duration:
2.0999603s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:17:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.099987766s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration:
2.078518547s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:16:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.078544493s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...........X...X............................................] duration:
2.15487914s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:15:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.154976558s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [............X...X...........................................] duration:
2.200965945s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:15:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.201007469s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration:
2.143650145s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:14:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.143676373s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration:
2.129975574s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:13:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.130003912s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...............X...X........................................] duration:
2.56783027s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:12:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.567858211s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [................X...X.......................................] duration:
2.140981186s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:12:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.141006938s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.................X...X......................................] duration:
2.519390907s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:11:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.519435522s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration:
2.232756s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:10:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.232784661s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...................X...X....................................] duration:
2.534921746s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:10:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.534965371s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....................X...X...................................] duration:
2.569491781s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:09:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.569512932s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration:
2.611244973s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:08:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.611326772s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [......................X...X.................................] duration:
2.554948306s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:08:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.554983148s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...X................................] duration:
2.208476711s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:07:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.208511031s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [........................X...X...............................] duration:
2.718332386s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:06:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.718362122s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration:
2.711406669s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:06:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.711437058s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration:
2.54412999s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:05:12 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.544159572s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...X............................] duration:
2.483652007s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:04:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.483677944s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [............................X...X...........................] duration:
2.510476305s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:03:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.510497743s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...X..........................] duration:
2.604631064s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:02:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.604657426s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [X.............................X...X.........................] duration:
2.099502527s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:02:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.099520142s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.X.............................X...X........................] duration:
2.529370748s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:01:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.529402327s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [X.X.............................X...X.......................] duration:
2.170926012s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:01:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.17095849s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.X.X.............................X...X......................] duration:
2.403069388s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:00:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.403100159s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..X.X.............................X...X.....................] duration:
2.699323806s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 19:00:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.69935262s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [X..X.X.............................X...X....................] duration:
2.576483205s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:59:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.576525457s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.X..X.X.............................X...X...................] duration:
2.14222927s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:59:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.142255859s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..X..X.X.............................X...X..................] duration:
2.622656628s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:58:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.622677654s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [...X..X.X.............................X...X.................] duration:
2.342622401s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:57:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.342641132s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [....X..X.X.............................X...X................] duration:
2.316944031s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:56:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.31697397s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.....X..X.X.............................X...X...............] duration:
42.221070854s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:56:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 42.221095773s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [......X..X.X.............................X...X..............] duration:
2.359188621s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:54:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.35921676s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.......X..X.X.............................X...X.............] duration:
2.297484092s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:53:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.297505984s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [........X..X.X.............................X...X............] duration:
2.593121067s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:52:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.593144499s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [.........X..X.X.............................X...X...........] duration:
2.579576137s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:51:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.579606981s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [..........X..X.X.............................X...X..........] duration:
2.439636184s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:50:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.439670447s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
5 out of 60 is failed (threshold=3) [...........X..X.X.............................X...X.........] duration:
2.711476397s trace:
https://jaeger.dev.storj.io/trace/32e71cb3854943d3
FAIL (2026-03-17 18:50:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.596939273 (271h43m48.193710296s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.597598355 (271h43m48.194369387s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.598635003 (271h43m48.195406029s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.599426619 (271h43m48.196197652s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.601148281 (271h43m48.197919313s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.604112007 (271h43m48.200883038s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.606640883 (271h43m48.203411916s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.609000949 (271h43m48.205771983s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.613266292 (271h43m48.210037324s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.617071393 (271h43m48.213842425s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:50.620780797 (271h43m48.21755183s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Uploading piece...
Mar 17 18:43:51.014144493 (271h43m48.610915526s) [upload=304355]: Next returned nil segment
Mar 17 18:43:51.014161653 (271h43m48.610932688s) [upload=304355]: Waiting for error group managing segments...
Mar 17 18:43:51.208306536 (271h43m48.805077566s) [noise=true , address=81.171.14.70:4027 , piece_id=YSHNTODSDIKZESC5RJBXFVMK6P5XTS7RTOWYDBS2O7FXAX7T2AFQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.213317344 (271h43m48.810088383s) [noise=true , address=81.171.14.70:4040 , piece_id=YNEG56UE7FT43CXKANNJSOSG3GVYHJ4FG2V3PQI6JW5T5UXM2V6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.223526049 (271h43m48.820297087s) [noise=true , address=81.171.14.70:4036 , piece_id=2XVM5F7MXMBVLYB5YAX3TILEUMXSPDOZWGDQDOOYGXBGSLCNLXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.230237682 (271h43m48.827008698s) [noise=true , address=81.171.14.70:4035 , piece_id=EU3TS6VRI3UEG7DLRDFC6FQ6M24R3CGMUC5JU2Q6NRC4VRLOKYHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.240039073 (271h43m48.836810101s) [noise=true , address=81.171.14.70:4033 , piece_id=PPK355IMSA264EKUH4XRA3EMSRW3ZAPROZZOYBWBWYPGKS6FDXSA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.241636501 (271h43m48.83840753s) [noise=true , address=81.171.14.70:4045 , piece_id=NWBMHS5W7FU3C2TGI3EVE6XLVSUN2NMYMU6IZEZ2EXULJWG2INUA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.244747460 (271h43m48.841518486s) [noise=true , address=81.171.14.70:4029 , piece_id=KDXXMUC24MJP4X3NVA5W5365AQFER5T2OYYUCUD7YHY566OVHKKA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.249283839 (271h43m48.84605487s) [noise=true , address=89.149.201.147:4023 , piece_id=E6P2KN7EMYBPI7ANF6I7RW4SVMGDSIIPHZF2TEIIFPMXVQEQMVFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.250696479 (271h43m48.847467504s) [noise=true , address=81.171.14.70:4028 , piece_id=T5HQEGZZVW3H7N2PHWUSZK4Y6CGGV7H7LHMLKUB44JK7ITODJ44A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.254491465 (271h43m48.85126249s) [noise=true , address=81.171.14.70:4039 , piece_id=TOC7KZHNZQAEURL4STHUX4O5NYCY3UALRLTREU4AZTXQOJV3XCAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.256138328 (271h43m48.852909374s) [noise=true , address=89.149.201.147:4004 , piece_id=7MU6DJLPBPAYUQNXVHNJ2VIXQ5XC4FGNACJVBLLFLYMBXR7VADHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.257247887 (271h43m48.854018918s) [noise=true , address=81.171.14.70:4042 , piece_id=RSPYM5SBTRQVL676SWCNCPUZP7WVZNPCTGIOBFQYC7YNBQXBQRJQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.264714686 (271h43m48.861485717s) [noise=true , address=81.171.14.70:4043 , piece_id=5MHRFDUDVEH7QFXPUTOPADY67ARND3TEQZXV5IGOYQYVB4OP22ZQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.267069109 (271h43m48.863840133s) [noise=true , address=81.171.14.70:4047 , piece_id=VNO3Y4EGCW7JHR3NYKJG5PSRBLLZBZLH6TJN6WUITYNLNLLVVSFA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.285081421 (271h43m48.881852451s) [noise=true , address=81.171.14.70:4025 , piece_id=BA7DAZT6RECHH67PJOOOD6K7WSKFSEHGJUJPAK3Y7EJHFAJTLQHQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.286012931 (271h43m48.882783949s) [noise=true , address=185.167.204.206:4052 , piece_id=LTEFUECRJ7FP4LKRJOIOTTLNLQTG2VSY46QLJO5TISSPXD4STPCA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.291987259 (271h43m48.888758287s) [noise=true , address=89.149.201.147:4001 , piece_id=37WCZ2UPC7YZCDBHCLQPLDLNMCKX53SA66SICWYUZDGZNEYH5P4Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.322595472 (271h43m48.919366497s) [noise=true , address=89.149.201.147:4002 , piece_id=MCG72U46VSRYIY2YCVRNJCVFTPPX5VH6J7UWDLXN4UTMHP6Y4A6Q, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340454625 (271h43m48.937225639s) [noise=true , address=185.167.204.206:4062 , piece_id=GKR5RHHPTGRGBAIAA45KHX4Z4WP7IPLI5K6SOU56CKRGPB2UXLAA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.340718566 (271h43m48.937489593s) [noise=true , address=185.167.204.206:4059 , piece_id=BYFO252V4VQSTUR5ZQH5Z5GPZ5UWQUNYYM5KEMOQD7T4QTWXO3RQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344358107 (271h43m48.941129137s) [noise=true , address=185.167.204.205:4003 , piece_id=3ZOJYKYGEULH6DP6X75AOYEE7GP4HTUDNGSXPAKP75UJIA3HD32A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.344521316 (271h43m48.941292356s) [noise=true , address=185.167.204.205:4026 , piece_id=IINFYHULKK3NVITBYGTGGZSTGVS5IHD4Y3PYJ2ZI44U4GJHYKEVQ, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:51.710308347 (271h43m49.307079362s) [noise=true , address=81.171.14.70:4034 , piece_id=N4ZIP4NLHWNI4YC4VS27M2SVAAOGLBOTF73UQTXLY63RZRO6XOGA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.042022074 (271h43m49.638793087s) [noise=true , address=185.167.204.206:4050 , piece_id=2HVVFROYA4GVKMDG7RA6JB5SVB752NDMS6ST2AH7A7C7OCOPTYOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:43:52.537232280 (271h43m50.13400331s) [noise=true , address=185.167.204.205:4004 , piece_id=MGJYB33RC72AHOUQN7YW4CXVJU6BKLOFOPB7KNZZTUZNWMQVWQOA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: <nil>
Mar 17 18:44:50.186022442 (271h44m47.782793472s) [noise=true , address=89.149.201.147:4013 , piece_id=RJIXWWABM5EZEHNYLKRN3PX5PHUSPLV5ADSIKJYJ7FW3D2I2MY6A, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:50266->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186208101 (271h44m47.782979127s) [noise=true , address=89.149.201.147:4005 , piece_id=6VFUFLRQX4F4C42UUYYWVCA5KMVMEJ2TMPGQFYYRM5MAYUMN6IWA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:14cSz6XLmfQYFmiCDqybBjNJGY9tUaNxsk8MfKc1ZHxZtRirZK, address:89.149.201.147:4005): protocol: read tcp 159.223.143.39:53612->89.149.201.147:4005: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186223052 (271h44m47.782994068s) [noise=true , address=89.149.201.147:4018 , piece_id=HSIK6ZJDTRPR7NDVUJBHRT3SUT4UGIXSGZIW5GGBWIPPYX2VI7NA, seg_pos={0 0}, upload=304355]: Done uploading piece. err: ecclient: upload failed (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua, address:89.149.201.147:4018): protocol: read tcp 159.223.143.39:35522->89.149.201.147:4018: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 17 18:44:50.186250571 (271h44m47.783021592s) [seg_pos={0 0}, upload=304355]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 17 18:44:50.291559895 (271h44m47.888330926s) [upload=304355]: Done uploading segments...
Mar 17 18:44:50.291613215 (271h44m47.888384241s) [upload=304355]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.71162781s
core
uplink
eu-select-1
eu1-placement-15
|