Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...............XX....X....X.................................] duration: 2.188836981s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:58:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.188857793s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [................XX....X....X................................] duration: 2.122271815s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:57:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.122358848s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.................XX....X....X...............................] duration: 2.104489007s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:56:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.104517338s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..................XX....X....X..............................] duration: 2.159458038s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:55:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.15948489s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...................XX....X....X.............................] duration: 2.172881304s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:55:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.172903837s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [....................XX....X....X............................] duration: 2.158272493s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:54:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.158295156s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.....................XX....X....X...........................] duration: 2.155823841s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:53:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.155868964s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [......................XX....X....X..........................] duration: 2.105310781s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:53:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.105340967s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.......................XX....X....X.........................] duration: 2.565636847s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:52:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.565689073s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [........................XX....X....X........................] duration: 2.148339812s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:51:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.148462917s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.........................XX....X....X.......................] duration: 2.103815877s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:50:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.103843762s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..........................XX....X....X......................] duration: 2.136748501s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:49:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.136776226s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...........................XX....X....X.....................] duration: 2.098381347s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:49:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.098409391s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [............................XX....X....X....................] duration: 2.13632648s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:48:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.136353925s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.............................XX....X....X...................] duration: 2.129497542s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:47:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.130296407s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..............................XX....X....X..................] duration: 2.177480284s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:46:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.177538673s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...............................XX....X....X.................] duration: 2.114109203s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:45:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.114141608s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [................................XX....X....X................] duration: 2.181358243s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:44:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.181384728s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.................................XX....X....X...............] duration: 2.09337966s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:44:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.093408897s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..................................XX....X....X..............] duration: 2.166810664s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:43:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.16683931s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...................................XX....X....X.............] duration: 2.564722253s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:42:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.564747079s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [....................................XX....X....X............] duration: 2.165882676s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:41:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.16590873s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.....................................XX....X....X...........] duration: 2.252404801s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:41:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.252443262s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [......................................XX....X....X..........] duration: 2.092284248s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:40:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.092311354s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.......................................XX....X....X.........] duration: 2.442050547s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:39:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.442079393s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [........................................XX....X....X........] duration: 2.356362075s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:39:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.356389543s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.........................................XX....X....X.......] duration: 2.206166494s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:38:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.206198399s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..........................................XX....X....X......] duration: 23.797558918s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:38:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 23.797585897s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...........................................XX....X....X.....] duration: 2.602444324s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:38:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.602484633s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [............................................XX....X....X....] duration: 2.575582286s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:37:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.575607977s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.............................................XX....X....X...] duration: 2.136687332s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:36:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.136796631s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..............................................XX....X....X..] duration: 2.649354688s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:35:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.649381276s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...............................................XX....X....X.] duration: 2.376165968s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:35:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.376191249s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [................................................XX....X....X] duration: 1m0.103373971s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 14:35:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 1m0.103399109s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.................................................XX....X....] duration: 2.153214313s trace: https://jaeger.dev.storj.io/trace/180b60394b05d310 FAIL (2026-03-11 14:33:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9638247 (123h30m0.466409284s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.870710147 (123h30m0.467481184s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.871661256 (123h30m0.468432304s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.873022571 (123h30m0.469793607s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.874643535 (123h30m0.471414572s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.875521780 (123h30m0.472292816s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.876314046 (123h30m0.473085084s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.877307302 (123h30m0.47407834s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878120323 (123h30m0.474891356s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878970929 (123h30m0.475741964s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.879842684 (123h30m0.47661372s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.881440676 (123h30m0.478211713s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:03.350414903 (123h30m0.947185939s) [upload=138331]: Next returned nil segment Mar 11 14:30:03.350434348 (123h30m0.947205383s) [upload=138331]: Waiting for error group managing segments... Mar 11 14:30:03.615715372 (123h30m1.212486386s) [noise=true , address=185.167.204.205:4024 , piece_id=6C7W5LX4AIJO74VFH2EN2XNHREOLWC6PDO7NFUFBFADIWPMIY5BA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.617816608 (123h30m1.214587637s) [noise=true , address=185.167.204.205:4028 , piece_id=OYCKUK5CXLRC7QXBZBGHJJ2W3LCHIZF5YLURBWCNNWDPMHJVDZ5Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.621978927 (123h30m1.218749939s) [noise=true , address=81.171.14.70:4037 , piece_id=MUDZCJGHRPXKAHZDPADBVVW7E5GKKF4ZGWQFCUCB4G7MHC67LDQA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.623701901 (123h30m1.220472922s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.626897602 (123h30m1.223668616s) [noise=true , address=81.171.14.70:4026 , piece_id=CIRKBPLSNT6WNUHRSMT2GDXGU6WY74AQQCQYNRUMVDGTLFPMZAYA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630194420 (123h30m1.226965433s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630575853 (123h30m1.227346897s) [noise=true , address=185.167.204.205:4010 , piece_id=2SYYLTXHDBFYBPQZ7M2B7KAYJHTPZEO3XBRADIBSJOUDYWGH35VA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.636708734 (123h30m1.233479767s) [noise=true , address=185.167.204.205:4002 , piece_id=6IIFV4SESEAWZ4B377DO72FL2BD2FPOOU3HGPU4RUDEPCZ5BE6NA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.652803660 (123h30m1.249574688s) [noise=true , address=81.171.14.70:4033 , piece_id=PRHG5RLW2KQBUKL5KAONQ6E6UKKFYM5DIPLUQDIWHMWCAH5XYGSQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.653817160 (123h30m1.250588188s) [noise=true , address=89.149.201.147:4007 , piece_id=KD62RP6L6QK6LX7MQWR2OTH3SA32NTJGA3VXJDYO3SMAPJK74CEQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.654649356 (123h30m1.251420385s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.655908051 (123h30m1.252679076s) [noise=true , address=89.149.201.147:4012 , piece_id=K2EJ7NNUZV7FABFAKLP67BPP3CFS7OLVIUSMZFJEGW6J6ZTU26GQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657629910 (123h30m1.254400939s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657708715 (123h30m1.254479746s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.658434642 (123h30m1.255205674s) [noise=true , address=185.167.204.205:4005 , piece_id=GYXNYBXMVGRSUDLGTY7ZG5LAZXC2HKVN7JIYZ3662BAXP7BH6M2A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.664450232 (123h30m1.261221264s) [noise=true , address=89.149.201.147:4001 , piece_id=UZZE4R5YEUFNUWJ5ZDDX7CEFEWBNLSJID4NOTUZ7SE2WJTK6A2EQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.674278034 (123h30m1.27104906s) [noise=true , address=185.167.204.205:4035 , piece_id=UOO2KJZ4BJNN6LB3UVR7UW6IDGI6FZB2DW6JHFDG67TMAWR2P7EA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.686505330 (123h30m1.28327636s) [noise=true , address=89.149.201.147:4015 , piece_id=C7RQB3RZA4HF6NF3G2VIQIXTBZV57GYQH3PT3SKLJTPX5M564MNQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.696762200 (123h30m1.293533232s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.714446295 (123h30m1.311217321s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.715121893 (123h30m1.311892922s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.719512938 (123h30m1.316283967s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.725759730 (123h30m1.322530744s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.726058260 (123h30m1.322829289s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.737691839 (123h30m1.334462869s) [noise=true , address=185.167.204.205:4025 , piece_id=LXIONP743DW3YCRMAI3OAIZFIJCULTPI4GNREC3GVAUW2GJ3PUSA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:31:02.440473955 (123h31m0.037244978s) [noise=true , address=185.167.204.206:4054 , piece_id=F6ZEZNTWAROSXW5EZDW74NHT2KA4KIMAJJMSO2VW5ZRVMKGRINZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 159.223.143.39:42104->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440783604 (123h31m0.037554619s) [noise=true , address=185.167.204.205:4004 , piece_id=226VWKQUYNFO2IMACM3CD23ONMPSADL4DGSHFBPK4OJXYTXVQVRQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:49678->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440826526 (123h31m0.037597535s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 159.223.143.39:41468->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440863103 (123h31m0.037634127s) [seg_pos={0 0}, upload=138331]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Mar 11 14:31:02.541933298 (123h31m0.13870432s) [upload=138331]: Done uploading segments... Mar 11 14:31:02.541971901 (123h31m0.138742927s) [upload=138331]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 2.153244473s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..................................................XX....X...] duration: 2.609583304s trace: https://jaeger.dev.storj.io/trace/180b60394b05d310 FAIL (2026-03-11 14:32:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9638247 (123h30m0.466409284s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.870710147 (123h30m0.467481184s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.871661256 (123h30m0.468432304s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.873022571 (123h30m0.469793607s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.874643535 (123h30m0.471414572s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.875521780 (123h30m0.472292816s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.876314046 (123h30m0.473085084s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.877307302 (123h30m0.47407834s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878120323 (123h30m0.474891356s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878970929 (123h30m0.475741964s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.879842684 (123h30m0.47661372s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.881440676 (123h30m0.478211713s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:03.350414903 (123h30m0.947185939s) [upload=138331]: Next returned nil segment Mar 11 14:30:03.350434348 (123h30m0.947205383s) [upload=138331]: Waiting for error group managing segments... Mar 11 14:30:03.615715372 (123h30m1.212486386s) [noise=true , address=185.167.204.205:4024 , piece_id=6C7W5LX4AIJO74VFH2EN2XNHREOLWC6PDO7NFUFBFADIWPMIY5BA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.617816608 (123h30m1.214587637s) [noise=true , address=185.167.204.205:4028 , piece_id=OYCKUK5CXLRC7QXBZBGHJJ2W3LCHIZF5YLURBWCNNWDPMHJVDZ5Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.621978927 (123h30m1.218749939s) [noise=true , address=81.171.14.70:4037 , piece_id=MUDZCJGHRPXKAHZDPADBVVW7E5GKKF4ZGWQFCUCB4G7MHC67LDQA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.623701901 (123h30m1.220472922s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.626897602 (123h30m1.223668616s) [noise=true , address=81.171.14.70:4026 , piece_id=CIRKBPLSNT6WNUHRSMT2GDXGU6WY74AQQCQYNRUMVDGTLFPMZAYA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630194420 (123h30m1.226965433s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630575853 (123h30m1.227346897s) [noise=true , address=185.167.204.205:4010 , piece_id=2SYYLTXHDBFYBPQZ7M2B7KAYJHTPZEO3XBRADIBSJOUDYWGH35VA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.636708734 (123h30m1.233479767s) [noise=true , address=185.167.204.205:4002 , piece_id=6IIFV4SESEAWZ4B377DO72FL2BD2FPOOU3HGPU4RUDEPCZ5BE6NA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.652803660 (123h30m1.249574688s) [noise=true , address=81.171.14.70:4033 , piece_id=PRHG5RLW2KQBUKL5KAONQ6E6UKKFYM5DIPLUQDIWHMWCAH5XYGSQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.653817160 (123h30m1.250588188s) [noise=true , address=89.149.201.147:4007 , piece_id=KD62RP6L6QK6LX7MQWR2OTH3SA32NTJGA3VXJDYO3SMAPJK74CEQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.654649356 (123h30m1.251420385s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.655908051 (123h30m1.252679076s) [noise=true , address=89.149.201.147:4012 , piece_id=K2EJ7NNUZV7FABFAKLP67BPP3CFS7OLVIUSMZFJEGW6J6ZTU26GQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657629910 (123h30m1.254400939s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657708715 (123h30m1.254479746s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.658434642 (123h30m1.255205674s) [noise=true , address=185.167.204.205:4005 , piece_id=GYXNYBXMVGRSUDLGTY7ZG5LAZXC2HKVN7JIYZ3662BAXP7BH6M2A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.664450232 (123h30m1.261221264s) [noise=true , address=89.149.201.147:4001 , piece_id=UZZE4R5YEUFNUWJ5ZDDX7CEFEWBNLSJID4NOTUZ7SE2WJTK6A2EQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.674278034 (123h30m1.27104906s) [noise=true , address=185.167.204.205:4035 , piece_id=UOO2KJZ4BJNN6LB3UVR7UW6IDGI6FZB2DW6JHFDG67TMAWR2P7EA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.686505330 (123h30m1.28327636s) [noise=true , address=89.149.201.147:4015 , piece_id=C7RQB3RZA4HF6NF3G2VIQIXTBZV57GYQH3PT3SKLJTPX5M564MNQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.696762200 (123h30m1.293533232s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.714446295 (123h30m1.311217321s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.715121893 (123h30m1.311892922s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.719512938 (123h30m1.316283967s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.725759730 (123h30m1.322530744s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.726058260 (123h30m1.322829289s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.737691839 (123h30m1.334462869s) [noise=true , address=185.167.204.205:4025 , piece_id=LXIONP743DW3YCRMAI3OAIZFIJCULTPI4GNREC3GVAUW2GJ3PUSA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:31:02.440473955 (123h31m0.037244978s) [noise=true , address=185.167.204.206:4054 , piece_id=F6ZEZNTWAROSXW5EZDW74NHT2KA4KIMAJJMSO2VW5ZRVMKGRINZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 159.223.143.39:42104->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440783604 (123h31m0.037554619s) [noise=true , address=185.167.204.205:4004 , piece_id=226VWKQUYNFO2IMACM3CD23ONMPSADL4DGSHFBPK4OJXYTXVQVRQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:49678->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440826526 (123h31m0.037597535s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 159.223.143.39:41468->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440863103 (123h31m0.037634127s) [seg_pos={0 0}, upload=138331]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Mar 11 14:31:02.541933298 (123h31m0.13870432s) [upload=138331]: Done uploading segments... Mar 11 14:31:02.541971901 (123h31m0.138742927s) [upload=138331]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 2.609672532s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...................................................XX....X..] duration: 2.565542961s trace: https://jaeger.dev.storj.io/trace/180b60394b05d310 FAIL (2026-03-11 14:32:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9638247 (123h30m0.466409284s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.870710147 (123h30m0.467481184s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.871661256 (123h30m0.468432304s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.873022571 (123h30m0.469793607s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.874643535 (123h30m0.471414572s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.875521780 (123h30m0.472292816s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.876314046 (123h30m0.473085084s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.877307302 (123h30m0.47407834s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878120323 (123h30m0.474891356s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878970929 (123h30m0.475741964s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.879842684 (123h30m0.47661372s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.881440676 (123h30m0.478211713s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:03.350414903 (123h30m0.947185939s) [upload=138331]: Next returned nil segment Mar 11 14:30:03.350434348 (123h30m0.947205383s) [upload=138331]: Waiting for error group managing segments... Mar 11 14:30:03.615715372 (123h30m1.212486386s) [noise=true , address=185.167.204.205:4024 , piece_id=6C7W5LX4AIJO74VFH2EN2XNHREOLWC6PDO7NFUFBFADIWPMIY5BA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.617816608 (123h30m1.214587637s) [noise=true , address=185.167.204.205:4028 , piece_id=OYCKUK5CXLRC7QXBZBGHJJ2W3LCHIZF5YLURBWCNNWDPMHJVDZ5Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.621978927 (123h30m1.218749939s) [noise=true , address=81.171.14.70:4037 , piece_id=MUDZCJGHRPXKAHZDPADBVVW7E5GKKF4ZGWQFCUCB4G7MHC67LDQA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.623701901 (123h30m1.220472922s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.626897602 (123h30m1.223668616s) [noise=true , address=81.171.14.70:4026 , piece_id=CIRKBPLSNT6WNUHRSMT2GDXGU6WY74AQQCQYNRUMVDGTLFPMZAYA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630194420 (123h30m1.226965433s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630575853 (123h30m1.227346897s) [noise=true , address=185.167.204.205:4010 , piece_id=2SYYLTXHDBFYBPQZ7M2B7KAYJHTPZEO3XBRADIBSJOUDYWGH35VA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.636708734 (123h30m1.233479767s) [noise=true , address=185.167.204.205:4002 , piece_id=6IIFV4SESEAWZ4B377DO72FL2BD2FPOOU3HGPU4RUDEPCZ5BE6NA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.652803660 (123h30m1.249574688s) [noise=true , address=81.171.14.70:4033 , piece_id=PRHG5RLW2KQBUKL5KAONQ6E6UKKFYM5DIPLUQDIWHMWCAH5XYGSQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.653817160 (123h30m1.250588188s) [noise=true , address=89.149.201.147:4007 , piece_id=KD62RP6L6QK6LX7MQWR2OTH3SA32NTJGA3VXJDYO3SMAPJK74CEQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.654649356 (123h30m1.251420385s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.655908051 (123h30m1.252679076s) [noise=true , address=89.149.201.147:4012 , piece_id=K2EJ7NNUZV7FABFAKLP67BPP3CFS7OLVIUSMZFJEGW6J6ZTU26GQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657629910 (123h30m1.254400939s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657708715 (123h30m1.254479746s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.658434642 (123h30m1.255205674s) [noise=true , address=185.167.204.205:4005 , piece_id=GYXNYBXMVGRSUDLGTY7ZG5LAZXC2HKVN7JIYZ3662BAXP7BH6M2A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.664450232 (123h30m1.261221264s) [noise=true , address=89.149.201.147:4001 , piece_id=UZZE4R5YEUFNUWJ5ZDDX7CEFEWBNLSJID4NOTUZ7SE2WJTK6A2EQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.674278034 (123h30m1.27104906s) [noise=true , address=185.167.204.205:4035 , piece_id=UOO2KJZ4BJNN6LB3UVR7UW6IDGI6FZB2DW6JHFDG67TMAWR2P7EA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.686505330 (123h30m1.28327636s) [noise=true , address=89.149.201.147:4015 , piece_id=C7RQB3RZA4HF6NF3G2VIQIXTBZV57GYQH3PT3SKLJTPX5M564MNQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.696762200 (123h30m1.293533232s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.714446295 (123h30m1.311217321s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.715121893 (123h30m1.311892922s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.719512938 (123h30m1.316283967s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.725759730 (123h30m1.322530744s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.726058260 (123h30m1.322829289s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.737691839 (123h30m1.334462869s) [noise=true , address=185.167.204.205:4025 , piece_id=LXIONP743DW3YCRMAI3OAIZFIJCULTPI4GNREC3GVAUW2GJ3PUSA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:31:02.440473955 (123h31m0.037244978s) [noise=true , address=185.167.204.206:4054 , piece_id=F6ZEZNTWAROSXW5EZDW74NHT2KA4KIMAJJMSO2VW5ZRVMKGRINZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 159.223.143.39:42104->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440783604 (123h31m0.037554619s) [noise=true , address=185.167.204.205:4004 , piece_id=226VWKQUYNFO2IMACM3CD23ONMPSADL4DGSHFBPK4OJXYTXVQVRQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:49678->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440826526 (123h31m0.037597535s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 159.223.143.39:41468->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440863103 (123h31m0.037634127s) [seg_pos={0 0}, upload=138331]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Mar 11 14:31:02.541933298 (123h31m0.13870432s) [upload=138331]: Done uploading segments... Mar 11 14:31:02.541971901 (123h31m0.138742927s) [upload=138331]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 2.565571648s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [....................................................XX....X.] duration: 2.52360106s trace: https://jaeger.dev.storj.io/trace/180b60394b05d310 FAIL (2026-03-11 14:31:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9638247 (123h30m0.466409284s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.870710147 (123h30m0.467481184s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.871661256 (123h30m0.468432304s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.873022571 (123h30m0.469793607s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.874643535 (123h30m0.471414572s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.875521780 (123h30m0.472292816s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.876314046 (123h30m0.473085084s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.877307302 (123h30m0.47407834s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878120323 (123h30m0.474891356s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878970929 (123h30m0.475741964s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.879842684 (123h30m0.47661372s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.881440676 (123h30m0.478211713s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:03.350414903 (123h30m0.947185939s) [upload=138331]: Next returned nil segment Mar 11 14:30:03.350434348 (123h30m0.947205383s) [upload=138331]: Waiting for error group managing segments... Mar 11 14:30:03.615715372 (123h30m1.212486386s) [noise=true , address=185.167.204.205:4024 , piece_id=6C7W5LX4AIJO74VFH2EN2XNHREOLWC6PDO7NFUFBFADIWPMIY5BA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.617816608 (123h30m1.214587637s) [noise=true , address=185.167.204.205:4028 , piece_id=OYCKUK5CXLRC7QXBZBGHJJ2W3LCHIZF5YLURBWCNNWDPMHJVDZ5Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.621978927 (123h30m1.218749939s) [noise=true , address=81.171.14.70:4037 , piece_id=MUDZCJGHRPXKAHZDPADBVVW7E5GKKF4ZGWQFCUCB4G7MHC67LDQA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.623701901 (123h30m1.220472922s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.626897602 (123h30m1.223668616s) [noise=true , address=81.171.14.70:4026 , piece_id=CIRKBPLSNT6WNUHRSMT2GDXGU6WY74AQQCQYNRUMVDGTLFPMZAYA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630194420 (123h30m1.226965433s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630575853 (123h30m1.227346897s) [noise=true , address=185.167.204.205:4010 , piece_id=2SYYLTXHDBFYBPQZ7M2B7KAYJHTPZEO3XBRADIBSJOUDYWGH35VA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.636708734 (123h30m1.233479767s) [noise=true , address=185.167.204.205:4002 , piece_id=6IIFV4SESEAWZ4B377DO72FL2BD2FPOOU3HGPU4RUDEPCZ5BE6NA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.652803660 (123h30m1.249574688s) [noise=true , address=81.171.14.70:4033 , piece_id=PRHG5RLW2KQBUKL5KAONQ6E6UKKFYM5DIPLUQDIWHMWCAH5XYGSQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.653817160 (123h30m1.250588188s) [noise=true , address=89.149.201.147:4007 , piece_id=KD62RP6L6QK6LX7MQWR2OTH3SA32NTJGA3VXJDYO3SMAPJK74CEQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.654649356 (123h30m1.251420385s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.655908051 (123h30m1.252679076s) [noise=true , address=89.149.201.147:4012 , piece_id=K2EJ7NNUZV7FABFAKLP67BPP3CFS7OLVIUSMZFJEGW6J6ZTU26GQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657629910 (123h30m1.254400939s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657708715 (123h30m1.254479746s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.658434642 (123h30m1.255205674s) [noise=true , address=185.167.204.205:4005 , piece_id=GYXNYBXMVGRSUDLGTY7ZG5LAZXC2HKVN7JIYZ3662BAXP7BH6M2A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.664450232 (123h30m1.261221264s) [noise=true , address=89.149.201.147:4001 , piece_id=UZZE4R5YEUFNUWJ5ZDDX7CEFEWBNLSJID4NOTUZ7SE2WJTK6A2EQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.674278034 (123h30m1.27104906s) [noise=true , address=185.167.204.205:4035 , piece_id=UOO2KJZ4BJNN6LB3UVR7UW6IDGI6FZB2DW6JHFDG67TMAWR2P7EA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.686505330 (123h30m1.28327636s) [noise=true , address=89.149.201.147:4015 , piece_id=C7RQB3RZA4HF6NF3G2VIQIXTBZV57GYQH3PT3SKLJTPX5M564MNQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.696762200 (123h30m1.293533232s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.714446295 (123h30m1.311217321s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.715121893 (123h30m1.311892922s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.719512938 (123h30m1.316283967s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.725759730 (123h30m1.322530744s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.726058260 (123h30m1.322829289s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.737691839 (123h30m1.334462869s) [noise=true , address=185.167.204.205:4025 , piece_id=LXIONP743DW3YCRMAI3OAIZFIJCULTPI4GNREC3GVAUW2GJ3PUSA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:31:02.440473955 (123h31m0.037244978s) [noise=true , address=185.167.204.206:4054 , piece_id=F6ZEZNTWAROSXW5EZDW74NHT2KA4KIMAJJMSO2VW5ZRVMKGRINZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 159.223.143.39:42104->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440783604 (123h31m0.037554619s) [noise=true , address=185.167.204.205:4004 , piece_id=226VWKQUYNFO2IMACM3CD23ONMPSADL4DGSHFBPK4OJXYTXVQVRQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:49678->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440826526 (123h31m0.037597535s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 159.223.143.39:41468->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440863103 (123h31m0.037634127s) [seg_pos={0 0}, upload=138331]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Mar 11 14:31:02.541933298 (123h31m0.13870432s) [upload=138331]: Done uploading segments... Mar 11 14:31:02.541971901 (123h31m0.138742927s) [upload=138331]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 2.523628874s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.....................................................XX....X] duration: 1m0.1047484s trace: https://jaeger.dev.storj.io/trace/180b60394b05d310 FAIL (2026-03-11 14:31:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== 9638247 (123h30m0.466409284s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.870710147 (123h30m0.467481184s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.871661256 (123h30m0.468432304s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.873022571 (123h30m0.469793607s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.874643535 (123h30m0.471414572s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.875521780 (123h30m0.472292816s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.876314046 (123h30m0.473085084s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.877307302 (123h30m0.47407834s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878120323 (123h30m0.474891356s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.878970929 (123h30m0.475741964s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.879842684 (123h30m0.47661372s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:02.881440676 (123h30m0.478211713s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Uploading piece... Mar 11 14:30:03.350414903 (123h30m0.947185939s) [upload=138331]: Next returned nil segment Mar 11 14:30:03.350434348 (123h30m0.947205383s) [upload=138331]: Waiting for error group managing segments... Mar 11 14:30:03.615715372 (123h30m1.212486386s) [noise=true , address=185.167.204.205:4024 , piece_id=6C7W5LX4AIJO74VFH2EN2XNHREOLWC6PDO7NFUFBFADIWPMIY5BA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.617816608 (123h30m1.214587637s) [noise=true , address=185.167.204.205:4028 , piece_id=OYCKUK5CXLRC7QXBZBGHJJ2W3LCHIZF5YLURBWCNNWDPMHJVDZ5Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.621978927 (123h30m1.218749939s) [noise=true , address=81.171.14.70:4037 , piece_id=MUDZCJGHRPXKAHZDPADBVVW7E5GKKF4ZGWQFCUCB4G7MHC67LDQA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.623701901 (123h30m1.220472922s) [noise=true , address=81.171.14.70:4030 , piece_id=OKHU3OQKPVKEELSQ5HDEUYF4XBD6BH5KHUKE5VNMI4N677VPEJAA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.626897602 (123h30m1.223668616s) [noise=true , address=81.171.14.70:4026 , piece_id=CIRKBPLSNT6WNUHRSMT2GDXGU6WY74AQQCQYNRUMVDGTLFPMZAYA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630194420 (123h30m1.226965433s) [noise=true , address=89.149.201.147:4009 , piece_id=POCVYDW76SDONGL6QT3YGJ56L6ZSKYM5YZOTA7PRIBAVU5GY3O5A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.630575853 (123h30m1.227346897s) [noise=true , address=185.167.204.205:4010 , piece_id=2SYYLTXHDBFYBPQZ7M2B7KAYJHTPZEO3XBRADIBSJOUDYWGH35VA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.636708734 (123h30m1.233479767s) [noise=true , address=185.167.204.205:4002 , piece_id=6IIFV4SESEAWZ4B377DO72FL2BD2FPOOU3HGPU4RUDEPCZ5BE6NA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.652803660 (123h30m1.249574688s) [noise=true , address=81.171.14.70:4033 , piece_id=PRHG5RLW2KQBUKL5KAONQ6E6UKKFYM5DIPLUQDIWHMWCAH5XYGSQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.653817160 (123h30m1.250588188s) [noise=true , address=89.149.201.147:4007 , piece_id=KD62RP6L6QK6LX7MQWR2OTH3SA32NTJGA3VXJDYO3SMAPJK74CEQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.654649356 (123h30m1.251420385s) [noise=true , address=89.149.201.147:4024 , piece_id=YFSMIEOGBBJIHAUVGM2WFAW33O2XBAMZSO2RQVXRRC4N5HTI4KXQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.655908051 (123h30m1.252679076s) [noise=true , address=89.149.201.147:4012 , piece_id=K2EJ7NNUZV7FABFAKLP67BPP3CFS7OLVIUSMZFJEGW6J6ZTU26GQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657629910 (123h30m1.254400939s) [noise=true , address=185.167.204.206:4058 , piece_id=FUG6ANRH4EDOKL2ZF6HNTQWFLXPCQM4FWC34MHOYQCXN7QRU37SA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.657708715 (123h30m1.254479746s) [noise=true , address=185.167.204.206:4062 , piece_id=R7LOMFYCHCVNWXSNUJ6H6Q347D3NEK74NR4XE7CLXBBLQRJT5FKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.658434642 (123h30m1.255205674s) [noise=true , address=185.167.204.205:4005 , piece_id=GYXNYBXMVGRSUDLGTY7ZG5LAZXC2HKVN7JIYZ3662BAXP7BH6M2A, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.664450232 (123h30m1.261221264s) [noise=true , address=89.149.201.147:4001 , piece_id=UZZE4R5YEUFNUWJ5ZDDX7CEFEWBNLSJID4NOTUZ7SE2WJTK6A2EQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.674278034 (123h30m1.27104906s) [noise=true , address=185.167.204.205:4035 , piece_id=UOO2KJZ4BJNN6LB3UVR7UW6IDGI6FZB2DW6JHFDG67TMAWR2P7EA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.686505330 (123h30m1.28327636s) [noise=true , address=89.149.201.147:4015 , piece_id=C7RQB3RZA4HF6NF3G2VIQIXTBZV57GYQH3PT3SKLJTPX5M564MNQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.696762200 (123h30m1.293533232s) [noise=true , address=89.149.201.147:4003 , piece_id=2AW4YK5ZHXXS5Z2UCUHIZSMXASO73MTXLNNUUFYSIDG6CHEQC3OQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.714446295 (123h30m1.311217321s) [noise=true , address=185.167.204.206:4060 , piece_id=BTXHQOBRIGOZYSGXLNRZGXYHHX4I3YPCNT5OUBI3YZQSE76MWZGA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.715121893 (123h30m1.311892922s) [noise=true , address=185.167.204.206:4041 , piece_id=MWWRVIEIXR6KDLSQI5MGB22WPHKHYSL4YYFIL36FFTM2IXFHDC2Q, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.719512938 (123h30m1.316283967s) [noise=true , address=185.167.204.206:4047 , piece_id=PWYFDO2VOMLWGRRVWHZQ2SKWHCP6SXSCOXTBGKEFHMC2CJAKGKDQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.725759730 (123h30m1.322530744s) [noise=true , address=185.167.204.205:4020 , piece_id=4WP2ROBP6WVCINCGORHI7TN5AB4C3MH4I57RKQQR2YAUVDSSNKRA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.726058260 (123h30m1.322829289s) [noise=true , address=89.149.201.147:4005 , piece_id=2WKWVHV3IZ7PYUO5NMU2EVO44PES6OSPOL7RQIOIILNXP7OGQWZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:30:03.737691839 (123h30m1.334462869s) [noise=true , address=185.167.204.205:4025 , piece_id=LXIONP743DW3YCRMAI3OAIZFIJCULTPI4GNREC3GVAUW2GJ3PUSA, seg_pos={0 0}, upload=138331]: Done uploading piece. err: <nil> Mar 11 14:31:02.440473955 (123h31m0.037244978s) [noise=true , address=185.167.204.206:4054 , piece_id=F6ZEZNTWAROSXW5EZDW74NHT2KA4KIMAJJMSO2VW5ZRVMKGRINZQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: read tcp 159.223.143.39:42104->185.167.204.206:4054: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440783604 (123h31m0.037554619s) [noise=true , address=185.167.204.205:4004 , piece_id=226VWKQUYNFO2IMACM3CD23ONMPSADL4DGSHFBPK4OJXYTXVQVRQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:49678->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440826526 (123h31m0.037597535s) [noise=true , address=185.167.204.205:4003 , piece_id=HXMNF2VQ2DWV4XCEQEVALI2POU6Q7CSA4ITP46K7S44DGXG5PMKQ, seg_pos={0 0}, upload=138331]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: read tcp 159.223.143.39:41468->185.167.204.205:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:31:02.440863103 (123h31m0.037634127s) [seg_pos={0 0}, upload=138331]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Mar 11 14:31:02.541933298 (123h31m0.13870432s) [upload=138331]: Done uploading segments... Mar 11 14:31:02.541971901 (123h31m0.138742927s) [upload=138331]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1m0.104776185s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 2.614832359s trace: https://jaeger.dev.storj.io/trace/1b8d045bb71dcab3 FAIL (2026-03-11 14:28:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== d=138243]: Uploading piece... Mar 11 14:25:27.315568420 (123h25m24.912339446s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316046205 (123h25m24.912817232s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316538754 (123h25m24.913309783s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316765900 (123h25m24.913536933s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.317468117 (123h25m24.91423915s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.318084767 (123h25m24.914855803s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.319976367 (123h25m24.916747392s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.320590986 (123h25m24.917362003s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.321347126 (123h25m24.918118155s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.740026188 (123h25m25.336797225s) [upload=138243]: Next returned nil segment Mar 11 14:25:27.740047785 (123h25m25.336818812s) [upload=138243]: Waiting for error group managing segments... Mar 11 14:25:27.923632750 (123h25m25.520413881s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.930573722 (123h25m25.527344752s) [noise=true , address=81.171.14.70:4038 , piece_id=7NCSOFH5OW7XJVRQOVSYTM2W77DGHYTNSKXCE4TGNXFO2LMDME3Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.936232310 (123h25m25.533003382s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.940098488 (123h25m25.53686954s) [noise=true , address=81.171.14.70:4044 , piece_id=FCTIFX4ZEORRFJ6CXQDZLYT3BCMQTSAR2V6CMAW5YLURARNRTYTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.943221826 (123h25m25.53999284s) [noise=true , address=185.167.204.206:4067 , piece_id=L24DCRBNEYMNTVZCNK2YR5JMRKG7OZQFDMFDMEAXVUJYD3OYPK4Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.944370187 (123h25m25.54114122s) [noise=true , address=185.167.204.205:4001 , piece_id=KARBA5QYZRFHNMIBS3KTW6Q54LXNZOGE2TRHXMD6IOPVVAEVWO3A, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.950942202 (123h25m25.547713223s) [noise=true , address=81.171.14.70:4036 , piece_id=ZPPNSV4NRDOZSPZZBE2ACVJXKFVCZKA2NEKGDXMABDRZ33QPZKSA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.953919292 (123h25m25.550690316s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.959731544 (123h25m25.556502569s) [noise=true , address=81.171.14.70:4026 , piece_id=K2YNYI24BFTH6SIR5RLMGGFXJLZINFBQWXYJRXTMDDRXZCF6SB5Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.960011765 (123h25m25.556782788s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.965199918 (123h25m25.561970931s) [noise=true , address=185.167.204.206:4058 , piece_id=TSCM6DYQSOFSAVT3VTMRVKSKEMSJ6WUJFNWBSUNVO54MW4KBRJKQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.985638440 (123h25m25.582409451s) [noise=true , address=185.167.204.206:4071 , piece_id=TQPUVBO2QZEV6YWELR3S2VLKZ2YGDQ5HLUSJSUXH4BVMHEHGR6XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004232892 (123h25m25.601003932s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004449795 (123h25m25.601220831s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.037825575 (123h25m25.634596585s) [noise=true , address=185.167.204.205:4007 , piece_id=WXWEU4EZFCHLHWEC3CZDSFJTKXVK7KQZVG6GCDFKB4BBGICCYYEQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.412395971 (123h25m26.009166997s) [noise=true , address=89.149.201.147:4020 , piece_id=QJNP5S5P6KSZ5C6USVKFHYTZHYYTXBEUKNDJGSAVTU2MXBNCDYFQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.415398895 (123h25m26.012169928s) [noise=true , address=81.171.14.70:4028 , piece_id=HQOHKR7CG2D2CS3SVB2IEW7YMSZVWSXRG3E55H5MN7WV3QJUCNSQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.433792844 (123h25m26.03056389s) [noise=true , address=89.149.201.147:4003 , piece_id=VN7FXEO3DEV4IGWPLAMW5TE6Q6LLVDTAHV4ZGXSDIT5BSWHEBISQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.434436482 (123h25m26.031207511s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.436291154 (123h25m26.033062178s) [noise=true , address=89.149.201.147:4006 , piece_id=HW454DO4CYWNSYP2R43ZY7AEREI4IEYKOVOLWCPMTOSPHADP2XQA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.438192263 (123h25m26.0349633s) [noise=true , address=81.171.14.70:4043 , piece_id=UYVC2RVQ3O4RWF6Z353MN4SFTKDHTX6X7WSZNV23NASYDAVQ65JA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.444004248 (123h25m26.040775276s) [noise=true , address=89.149.201.147:4012 , piece_id=CHTOKXHZFCRUDXPM5RXOGRZS5OJC4WPR7RC6VOUQKROALV7ESWTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.445707426 (123h25m26.042478438s) [noise=true , address=81.171.14.70:4039 , piece_id=WTBBDXIOTP3IMULAXHKXCTDIX62N4ITWD5XITH2DJ46WWMEQQ5XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:26:26.941701184 (123h26m24.538472222s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 159.223.143.39:45182->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942021282 (123h26m24.538792314s) [noise=true , address=185.167.204.206:4064 , piece_id=VNEBVIZUOI2L77XQO4NPIVBEPDNHLEGRB3E3GPRA6NQVKQUZQNZQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: read tcp 159.223.143.39:54280->185.167.204.206:4064: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942849137 (123h26m24.539620163s) [noise=true , address=185.167.204.206:4061 , piece_id=PMQYFM3BIVIJ6CFRLRUC63ZFRUW66WEWCJMFNN5DAGPNRLD7Z7OA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: read tcp 159.223.143.39:53030->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943367687 (123h26m24.540138716s) [noise=true , address=89.149.201.147:4023 , piece_id=WSFFQHYGUS6BVL64J6KTWKYYRQNA6Q4YDVEKESFGUC42SAZDP2GQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:58936->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943424551 (123h26m24.540195585s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:37048->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943500762 (123h26m24.540271785s) [seg_pos={0 0}, upload=138243]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Mar 11 14:26:27.047305337 (123h26m24.644076363s) [upload=138243]: Done uploading segments... Mar 11 14:26:27.047381417 (123h26m24.644152441s) [upload=138243]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.614863202s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 2.216179457s trace: https://jaeger.dev.storj.io/trace/1b8d045bb71dcab3 FAIL (2026-03-11 14:27:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== d=138243]: Uploading piece... Mar 11 14:25:27.315568420 (123h25m24.912339446s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316046205 (123h25m24.912817232s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316538754 (123h25m24.913309783s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316765900 (123h25m24.913536933s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.317468117 (123h25m24.91423915s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.318084767 (123h25m24.914855803s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.319976367 (123h25m24.916747392s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.320590986 (123h25m24.917362003s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.321347126 (123h25m24.918118155s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.740026188 (123h25m25.336797225s) [upload=138243]: Next returned nil segment Mar 11 14:25:27.740047785 (123h25m25.336818812s) [upload=138243]: Waiting for error group managing segments... Mar 11 14:25:27.923632750 (123h25m25.520413881s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.930573722 (123h25m25.527344752s) [noise=true , address=81.171.14.70:4038 , piece_id=7NCSOFH5OW7XJVRQOVSYTM2W77DGHYTNSKXCE4TGNXFO2LMDME3Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.936232310 (123h25m25.533003382s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.940098488 (123h25m25.53686954s) [noise=true , address=81.171.14.70:4044 , piece_id=FCTIFX4ZEORRFJ6CXQDZLYT3BCMQTSAR2V6CMAW5YLURARNRTYTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.943221826 (123h25m25.53999284s) [noise=true , address=185.167.204.206:4067 , piece_id=L24DCRBNEYMNTVZCNK2YR5JMRKG7OZQFDMFDMEAXVUJYD3OYPK4Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.944370187 (123h25m25.54114122s) [noise=true , address=185.167.204.205:4001 , piece_id=KARBA5QYZRFHNMIBS3KTW6Q54LXNZOGE2TRHXMD6IOPVVAEVWO3A, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.950942202 (123h25m25.547713223s) [noise=true , address=81.171.14.70:4036 , piece_id=ZPPNSV4NRDOZSPZZBE2ACVJXKFVCZKA2NEKGDXMABDRZ33QPZKSA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.953919292 (123h25m25.550690316s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.959731544 (123h25m25.556502569s) [noise=true , address=81.171.14.70:4026 , piece_id=K2YNYI24BFTH6SIR5RLMGGFXJLZINFBQWXYJRXTMDDRXZCF6SB5Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.960011765 (123h25m25.556782788s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.965199918 (123h25m25.561970931s) [noise=true , address=185.167.204.206:4058 , piece_id=TSCM6DYQSOFSAVT3VTMRVKSKEMSJ6WUJFNWBSUNVO54MW4KBRJKQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.985638440 (123h25m25.582409451s) [noise=true , address=185.167.204.206:4071 , piece_id=TQPUVBO2QZEV6YWELR3S2VLKZ2YGDQ5HLUSJSUXH4BVMHEHGR6XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004232892 (123h25m25.601003932s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004449795 (123h25m25.601220831s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.037825575 (123h25m25.634596585s) [noise=true , address=185.167.204.205:4007 , piece_id=WXWEU4EZFCHLHWEC3CZDSFJTKXVK7KQZVG6GCDFKB4BBGICCYYEQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.412395971 (123h25m26.009166997s) [noise=true , address=89.149.201.147:4020 , piece_id=QJNP5S5P6KSZ5C6USVKFHYTZHYYTXBEUKNDJGSAVTU2MXBNCDYFQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.415398895 (123h25m26.012169928s) [noise=true , address=81.171.14.70:4028 , piece_id=HQOHKR7CG2D2CS3SVB2IEW7YMSZVWSXRG3E55H5MN7WV3QJUCNSQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.433792844 (123h25m26.03056389s) [noise=true , address=89.149.201.147:4003 , piece_id=VN7FXEO3DEV4IGWPLAMW5TE6Q6LLVDTAHV4ZGXSDIT5BSWHEBISQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.434436482 (123h25m26.031207511s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.436291154 (123h25m26.033062178s) [noise=true , address=89.149.201.147:4006 , piece_id=HW454DO4CYWNSYP2R43ZY7AEREI4IEYKOVOLWCPMTOSPHADP2XQA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.438192263 (123h25m26.0349633s) [noise=true , address=81.171.14.70:4043 , piece_id=UYVC2RVQ3O4RWF6Z353MN4SFTKDHTX6X7WSZNV23NASYDAVQ65JA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.444004248 (123h25m26.040775276s) [noise=true , address=89.149.201.147:4012 , piece_id=CHTOKXHZFCRUDXPM5RXOGRZS5OJC4WPR7RC6VOUQKROALV7ESWTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.445707426 (123h25m26.042478438s) [noise=true , address=81.171.14.70:4039 , piece_id=WTBBDXIOTP3IMULAXHKXCTDIX62N4ITWD5XITH2DJ46WWMEQQ5XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:26:26.941701184 (123h26m24.538472222s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 159.223.143.39:45182->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942021282 (123h26m24.538792314s) [noise=true , address=185.167.204.206:4064 , piece_id=VNEBVIZUOI2L77XQO4NPIVBEPDNHLEGRB3E3GPRA6NQVKQUZQNZQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: read tcp 159.223.143.39:54280->185.167.204.206:4064: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942849137 (123h26m24.539620163s) [noise=true , address=185.167.204.206:4061 , piece_id=PMQYFM3BIVIJ6CFRLRUC63ZFRUW66WEWCJMFNN5DAGPNRLD7Z7OA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: read tcp 159.223.143.39:53030->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943367687 (123h26m24.540138716s) [noise=true , address=89.149.201.147:4023 , piece_id=WSFFQHYGUS6BVL64J6KTWKYYRQNA6Q4YDVEKESFGUC42SAZDP2GQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:58936->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943424551 (123h26m24.540195585s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:37048->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943500762 (123h26m24.540271785s) [seg_pos={0 0}, upload=138243]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Mar 11 14:26:27.047305337 (123h26m24.644076363s) [upload=138243]: Done uploading segments... Mar 11 14:26:27.047381417 (123h26m24.644152441s) [upload=138243]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.216230612s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 2.189110745s trace: https://jaeger.dev.storj.io/trace/1b8d045bb71dcab3 FAIL (2026-03-11 14:27:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== d=138243]: Uploading piece... Mar 11 14:25:27.315568420 (123h25m24.912339446s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316046205 (123h25m24.912817232s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316538754 (123h25m24.913309783s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316765900 (123h25m24.913536933s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.317468117 (123h25m24.91423915s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.318084767 (123h25m24.914855803s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.319976367 (123h25m24.916747392s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.320590986 (123h25m24.917362003s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.321347126 (123h25m24.918118155s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.740026188 (123h25m25.336797225s) [upload=138243]: Next returned nil segment Mar 11 14:25:27.740047785 (123h25m25.336818812s) [upload=138243]: Waiting for error group managing segments... Mar 11 14:25:27.923632750 (123h25m25.520413881s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.930573722 (123h25m25.527344752s) [noise=true , address=81.171.14.70:4038 , piece_id=7NCSOFH5OW7XJVRQOVSYTM2W77DGHYTNSKXCE4TGNXFO2LMDME3Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.936232310 (123h25m25.533003382s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.940098488 (123h25m25.53686954s) [noise=true , address=81.171.14.70:4044 , piece_id=FCTIFX4ZEORRFJ6CXQDZLYT3BCMQTSAR2V6CMAW5YLURARNRTYTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.943221826 (123h25m25.53999284s) [noise=true , address=185.167.204.206:4067 , piece_id=L24DCRBNEYMNTVZCNK2YR5JMRKG7OZQFDMFDMEAXVUJYD3OYPK4Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.944370187 (123h25m25.54114122s) [noise=true , address=185.167.204.205:4001 , piece_id=KARBA5QYZRFHNMIBS3KTW6Q54LXNZOGE2TRHXMD6IOPVVAEVWO3A, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.950942202 (123h25m25.547713223s) [noise=true , address=81.171.14.70:4036 , piece_id=ZPPNSV4NRDOZSPZZBE2ACVJXKFVCZKA2NEKGDXMABDRZ33QPZKSA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.953919292 (123h25m25.550690316s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.959731544 (123h25m25.556502569s) [noise=true , address=81.171.14.70:4026 , piece_id=K2YNYI24BFTH6SIR5RLMGGFXJLZINFBQWXYJRXTMDDRXZCF6SB5Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.960011765 (123h25m25.556782788s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.965199918 (123h25m25.561970931s) [noise=true , address=185.167.204.206:4058 , piece_id=TSCM6DYQSOFSAVT3VTMRVKSKEMSJ6WUJFNWBSUNVO54MW4KBRJKQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.985638440 (123h25m25.582409451s) [noise=true , address=185.167.204.206:4071 , piece_id=TQPUVBO2QZEV6YWELR3S2VLKZ2YGDQ5HLUSJSUXH4BVMHEHGR6XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004232892 (123h25m25.601003932s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004449795 (123h25m25.601220831s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.037825575 (123h25m25.634596585s) [noise=true , address=185.167.204.205:4007 , piece_id=WXWEU4EZFCHLHWEC3CZDSFJTKXVK7KQZVG6GCDFKB4BBGICCYYEQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.412395971 (123h25m26.009166997s) [noise=true , address=89.149.201.147:4020 , piece_id=QJNP5S5P6KSZ5C6USVKFHYTZHYYTXBEUKNDJGSAVTU2MXBNCDYFQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.415398895 (123h25m26.012169928s) [noise=true , address=81.171.14.70:4028 , piece_id=HQOHKR7CG2D2CS3SVB2IEW7YMSZVWSXRG3E55H5MN7WV3QJUCNSQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.433792844 (123h25m26.03056389s) [noise=true , address=89.149.201.147:4003 , piece_id=VN7FXEO3DEV4IGWPLAMW5TE6Q6LLVDTAHV4ZGXSDIT5BSWHEBISQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.434436482 (123h25m26.031207511s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.436291154 (123h25m26.033062178s) [noise=true , address=89.149.201.147:4006 , piece_id=HW454DO4CYWNSYP2R43ZY7AEREI4IEYKOVOLWCPMTOSPHADP2XQA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.438192263 (123h25m26.0349633s) [noise=true , address=81.171.14.70:4043 , piece_id=UYVC2RVQ3O4RWF6Z353MN4SFTKDHTX6X7WSZNV23NASYDAVQ65JA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.444004248 (123h25m26.040775276s) [noise=true , address=89.149.201.147:4012 , piece_id=CHTOKXHZFCRUDXPM5RXOGRZS5OJC4WPR7RC6VOUQKROALV7ESWTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.445707426 (123h25m26.042478438s) [noise=true , address=81.171.14.70:4039 , piece_id=WTBBDXIOTP3IMULAXHKXCTDIX62N4ITWD5XITH2DJ46WWMEQQ5XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:26:26.941701184 (123h26m24.538472222s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 159.223.143.39:45182->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942021282 (123h26m24.538792314s) [noise=true , address=185.167.204.206:4064 , piece_id=VNEBVIZUOI2L77XQO4NPIVBEPDNHLEGRB3E3GPRA6NQVKQUZQNZQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: read tcp 159.223.143.39:54280->185.167.204.206:4064: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942849137 (123h26m24.539620163s) [noise=true , address=185.167.204.206:4061 , piece_id=PMQYFM3BIVIJ6CFRLRUC63ZFRUW66WEWCJMFNN5DAGPNRLD7Z7OA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: read tcp 159.223.143.39:53030->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943367687 (123h26m24.540138716s) [noise=true , address=89.149.201.147:4023 , piece_id=WSFFQHYGUS6BVL64J6KTWKYYRQNA6Q4YDVEKESFGUC42SAZDP2GQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:58936->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943424551 (123h26m24.540195585s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:37048->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943500762 (123h26m24.540271785s) [seg_pos={0 0}, upload=138243]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Mar 11 14:26:27.047305337 (123h26m24.644076363s) [upload=138243]: Done uploading segments... Mar 11 14:26:27.047381417 (123h26m24.644152441s) [upload=138243]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.189136513s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 2.136704195s trace: https://jaeger.dev.storj.io/trace/1b8d045bb71dcab3 FAIL (2026-03-11 14:26:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== d=138243]: Uploading piece... Mar 11 14:25:27.315568420 (123h25m24.912339446s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316046205 (123h25m24.912817232s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316538754 (123h25m24.913309783s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316765900 (123h25m24.913536933s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.317468117 (123h25m24.91423915s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.318084767 (123h25m24.914855803s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.319976367 (123h25m24.916747392s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.320590986 (123h25m24.917362003s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.321347126 (123h25m24.918118155s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.740026188 (123h25m25.336797225s) [upload=138243]: Next returned nil segment Mar 11 14:25:27.740047785 (123h25m25.336818812s) [upload=138243]: Waiting for error group managing segments... Mar 11 14:25:27.923632750 (123h25m25.520413881s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.930573722 (123h25m25.527344752s) [noise=true , address=81.171.14.70:4038 , piece_id=7NCSOFH5OW7XJVRQOVSYTM2W77DGHYTNSKXCE4TGNXFO2LMDME3Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.936232310 (123h25m25.533003382s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.940098488 (123h25m25.53686954s) [noise=true , address=81.171.14.70:4044 , piece_id=FCTIFX4ZEORRFJ6CXQDZLYT3BCMQTSAR2V6CMAW5YLURARNRTYTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.943221826 (123h25m25.53999284s) [noise=true , address=185.167.204.206:4067 , piece_id=L24DCRBNEYMNTVZCNK2YR5JMRKG7OZQFDMFDMEAXVUJYD3OYPK4Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.944370187 (123h25m25.54114122s) [noise=true , address=185.167.204.205:4001 , piece_id=KARBA5QYZRFHNMIBS3KTW6Q54LXNZOGE2TRHXMD6IOPVVAEVWO3A, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.950942202 (123h25m25.547713223s) [noise=true , address=81.171.14.70:4036 , piece_id=ZPPNSV4NRDOZSPZZBE2ACVJXKFVCZKA2NEKGDXMABDRZ33QPZKSA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.953919292 (123h25m25.550690316s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.959731544 (123h25m25.556502569s) [noise=true , address=81.171.14.70:4026 , piece_id=K2YNYI24BFTH6SIR5RLMGGFXJLZINFBQWXYJRXTMDDRXZCF6SB5Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.960011765 (123h25m25.556782788s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.965199918 (123h25m25.561970931s) [noise=true , address=185.167.204.206:4058 , piece_id=TSCM6DYQSOFSAVT3VTMRVKSKEMSJ6WUJFNWBSUNVO54MW4KBRJKQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.985638440 (123h25m25.582409451s) [noise=true , address=185.167.204.206:4071 , piece_id=TQPUVBO2QZEV6YWELR3S2VLKZ2YGDQ5HLUSJSUXH4BVMHEHGR6XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004232892 (123h25m25.601003932s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004449795 (123h25m25.601220831s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.037825575 (123h25m25.634596585s) [noise=true , address=185.167.204.205:4007 , piece_id=WXWEU4EZFCHLHWEC3CZDSFJTKXVK7KQZVG6GCDFKB4BBGICCYYEQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.412395971 (123h25m26.009166997s) [noise=true , address=89.149.201.147:4020 , piece_id=QJNP5S5P6KSZ5C6USVKFHYTZHYYTXBEUKNDJGSAVTU2MXBNCDYFQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.415398895 (123h25m26.012169928s) [noise=true , address=81.171.14.70:4028 , piece_id=HQOHKR7CG2D2CS3SVB2IEW7YMSZVWSXRG3E55H5MN7WV3QJUCNSQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.433792844 (123h25m26.03056389s) [noise=true , address=89.149.201.147:4003 , piece_id=VN7FXEO3DEV4IGWPLAMW5TE6Q6LLVDTAHV4ZGXSDIT5BSWHEBISQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.434436482 (123h25m26.031207511s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.436291154 (123h25m26.033062178s) [noise=true , address=89.149.201.147:4006 , piece_id=HW454DO4CYWNSYP2R43ZY7AEREI4IEYKOVOLWCPMTOSPHADP2XQA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.438192263 (123h25m26.0349633s) [noise=true , address=81.171.14.70:4043 , piece_id=UYVC2RVQ3O4RWF6Z353MN4SFTKDHTX6X7WSZNV23NASYDAVQ65JA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.444004248 (123h25m26.040775276s) [noise=true , address=89.149.201.147:4012 , piece_id=CHTOKXHZFCRUDXPM5RXOGRZS5OJC4WPR7RC6VOUQKROALV7ESWTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.445707426 (123h25m26.042478438s) [noise=true , address=81.171.14.70:4039 , piece_id=WTBBDXIOTP3IMULAXHKXCTDIX62N4ITWD5XITH2DJ46WWMEQQ5XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:26:26.941701184 (123h26m24.538472222s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 159.223.143.39:45182->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942021282 (123h26m24.538792314s) [noise=true , address=185.167.204.206:4064 , piece_id=VNEBVIZUOI2L77XQO4NPIVBEPDNHLEGRB3E3GPRA6NQVKQUZQNZQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: read tcp 159.223.143.39:54280->185.167.204.206:4064: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942849137 (123h26m24.539620163s) [noise=true , address=185.167.204.206:4061 , piece_id=PMQYFM3BIVIJ6CFRLRUC63ZFRUW66WEWCJMFNN5DAGPNRLD7Z7OA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: read tcp 159.223.143.39:53030->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943367687 (123h26m24.540138716s) [noise=true , address=89.149.201.147:4023 , piece_id=WSFFQHYGUS6BVL64J6KTWKYYRQNA6Q4YDVEKESFGUC42SAZDP2GQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:58936->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943424551 (123h26m24.540195585s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:37048->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943500762 (123h26m24.540271785s) [seg_pos={0 0}, upload=138243]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Mar 11 14:26:27.047305337 (123h26m24.644076363s) [upload=138243]: Done uploading segments... Mar 11 14:26:27.047381417 (123h26m24.644152441s) [upload=138243]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.136724268s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.109189551s trace: https://jaeger.dev.storj.io/trace/1b8d045bb71dcab3 FAIL (2026-03-11 14:26:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== d=138243]: Uploading piece... Mar 11 14:25:27.315568420 (123h25m24.912339446s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316046205 (123h25m24.912817232s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316538754 (123h25m24.913309783s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.316765900 (123h25m24.913536933s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.317468117 (123h25m24.91423915s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.318084767 (123h25m24.914855803s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.319976367 (123h25m24.916747392s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.320590986 (123h25m24.917362003s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.321347126 (123h25m24.918118155s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Uploading piece... Mar 11 14:25:27.740026188 (123h25m25.336797225s) [upload=138243]: Next returned nil segment Mar 11 14:25:27.740047785 (123h25m25.336818812s) [upload=138243]: Waiting for error group managing segments... Mar 11 14:25:27.923632750 (123h25m25.520413881s) [noise=true , address=81.171.14.70:4048 , piece_id=QYR432F7Y5RND5O2BDKIB5IDEPZHLL2NTZTWIFZ5BSJQC7DJC4LQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.930573722 (123h25m25.527344752s) [noise=true , address=81.171.14.70:4038 , piece_id=7NCSOFH5OW7XJVRQOVSYTM2W77DGHYTNSKXCE4TGNXFO2LMDME3Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.936232310 (123h25m25.533003382s) [noise=true , address=81.171.14.70:4027 , piece_id=S3RFH5GZZJNHWGFHWNJWRD7WX6VRO27GHEFDELILZCG2ZSRJNLJA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.940098488 (123h25m25.53686954s) [noise=true , address=81.171.14.70:4044 , piece_id=FCTIFX4ZEORRFJ6CXQDZLYT3BCMQTSAR2V6CMAW5YLURARNRTYTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.943221826 (123h25m25.53999284s) [noise=true , address=185.167.204.206:4067 , piece_id=L24DCRBNEYMNTVZCNK2YR5JMRKG7OZQFDMFDMEAXVUJYD3OYPK4Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.944370187 (123h25m25.54114122s) [noise=true , address=185.167.204.205:4001 , piece_id=KARBA5QYZRFHNMIBS3KTW6Q54LXNZOGE2TRHXMD6IOPVVAEVWO3A, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.950942202 (123h25m25.547713223s) [noise=true , address=81.171.14.70:4036 , piece_id=ZPPNSV4NRDOZSPZZBE2ACVJXKFVCZKA2NEKGDXMABDRZ33QPZKSA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.953919292 (123h25m25.550690316s) [noise=true , address=89.149.201.147:4005 , piece_id=QHB53M52UH6HLKWDSGWDRNTEONW4JJDL5L4WV7UVD7NIYL47YDXA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.959731544 (123h25m25.556502569s) [noise=true , address=81.171.14.70:4026 , piece_id=K2YNYI24BFTH6SIR5RLMGGFXJLZINFBQWXYJRXTMDDRXZCF6SB5Q, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.960011765 (123h25m25.556782788s) [noise=true , address=89.149.201.147:4024 , piece_id=D5DVQUHYWIHNOUC6FRMGAKTEKUN6PA2SXGKMNYOK7MH4IQMW4LOA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.965199918 (123h25m25.561970931s) [noise=true , address=185.167.204.206:4058 , piece_id=TSCM6DYQSOFSAVT3VTMRVKSKEMSJ6WUJFNWBSUNVO54MW4KBRJKQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:27.985638440 (123h25m25.582409451s) [noise=true , address=185.167.204.206:4071 , piece_id=TQPUVBO2QZEV6YWELR3S2VLKZ2YGDQ5HLUSJSUXH4BVMHEHGR6XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004232892 (123h25m25.601003932s) [noise=true , address=185.167.204.205:4016 , piece_id=BBBMOEWD53Z2IANN3YENBT7UNUA4FEMJ7FUOOR3PAQEQPPS27LBQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.004449795 (123h25m25.601220831s) [noise=true , address=89.149.201.147:4016 , piece_id=Q7EKQ5C2ZK53GT6XM36NOUATTM3F2D7JISTG6QL57UGBRCPSPQWQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.037825575 (123h25m25.634596585s) [noise=true , address=185.167.204.205:4007 , piece_id=WXWEU4EZFCHLHWEC3CZDSFJTKXVK7KQZVG6GCDFKB4BBGICCYYEQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.412395971 (123h25m26.009166997s) [noise=true , address=89.149.201.147:4020 , piece_id=QJNP5S5P6KSZ5C6USVKFHYTZHYYTXBEUKNDJGSAVTU2MXBNCDYFQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.415398895 (123h25m26.012169928s) [noise=true , address=81.171.14.70:4028 , piece_id=HQOHKR7CG2D2CS3SVB2IEW7YMSZVWSXRG3E55H5MN7WV3QJUCNSQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.433792844 (123h25m26.03056389s) [noise=true , address=89.149.201.147:4003 , piece_id=VN7FXEO3DEV4IGWPLAMW5TE6Q6LLVDTAHV4ZGXSDIT5BSWHEBISQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.434436482 (123h25m26.031207511s) [noise=true , address=81.171.14.70:4047 , piece_id=QU7YFZK5JLCJYPUTRO7DCVKIBQQ6HMGYBZDOKFJXCK4XJHP242FA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.436291154 (123h25m26.033062178s) [noise=true , address=89.149.201.147:4006 , piece_id=HW454DO4CYWNSYP2R43ZY7AEREI4IEYKOVOLWCPMTOSPHADP2XQA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.438192263 (123h25m26.0349633s) [noise=true , address=81.171.14.70:4043 , piece_id=UYVC2RVQ3O4RWF6Z353MN4SFTKDHTX6X7WSZNV23NASYDAVQ65JA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.444004248 (123h25m26.040775276s) [noise=true , address=89.149.201.147:4012 , piece_id=CHTOKXHZFCRUDXPM5RXOGRZS5OJC4WPR7RC6VOUQKROALV7ESWTA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:25:28.445707426 (123h25m26.042478438s) [noise=true , address=81.171.14.70:4039 , piece_id=WTBBDXIOTP3IMULAXHKXCTDIX62N4ITWD5XITH2DJ46WWMEQQ5XQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: <nil> Mar 11 14:26:26.941701184 (123h26m24.538472222s) [noise=true , address=185.167.204.206:4057 , piece_id=IMRWCDUPJA532YZ2IUWLLYXJUQSXHLY5Y4BOJPZXV4ENVRFUGKQQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 159.223.143.39:45182->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942021282 (123h26m24.538792314s) [noise=true , address=185.167.204.206:4064 , piece_id=VNEBVIZUOI2L77XQO4NPIVBEPDNHLEGRB3E3GPRA6NQVKQUZQNZQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: read tcp 159.223.143.39:54280->185.167.204.206:4064: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.942849137 (123h26m24.539620163s) [noise=true , address=185.167.204.206:4061 , piece_id=PMQYFM3BIVIJ6CFRLRUC63ZFRUW66WEWCJMFNN5DAGPNRLD7Z7OA, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:1G18tJ6BsYF3A1sLpRTTGzomqRWsRsj8tbHMJQeR1tZunoTDia, address:185.167.204.206:4061): protocol: read tcp 159.223.143.39:53030->185.167.204.206:4061: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943367687 (123h26m24.540138716s) [noise=true , address=89.149.201.147:4023 , piece_id=WSFFQHYGUS6BVL64J6KTWKYYRQNA6Q4YDVEKESFGUC42SAZDP2GQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:12BaeSxjXneBKoGKVrRM686sq386Bhn1YzzBFG9we8fHbcc9tbv, address:89.149.201.147:4023): protocol: read tcp 159.223.143.39:58936->89.149.201.147:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943424551 (123h26m24.540195585s) [noise=true , address=89.149.201.147:4013 , piece_id=DFPMDEACCJKJBLUD76IWGOJLN6P6J6LSVDDVNW5FKPH6RFVAZXMQ, seg_pos={0 0}, upload=138243]: Done uploading piece. err: ecclient: upload failed (node:125ZKP9g2cY7B3b8eyfHqoChUG2nYtz3nbFRGA6szgtACzT4M6J, address:89.149.201.147:4013): protocol: read tcp 159.223.143.39:37048->89.149.201.147:4013: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:26:26.943500762 (123h26m24.540271785s) [seg_pos={0 0}, upload=138243]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Mar 11 14:26:27.047305337 (123h26m24.644076363s) [upload=138243]: Done uploading segments... Mar 11 14:26:27.047381417 (123h26m24.644152441s) [upload=138243]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 1m0.109204097s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.124668164s trace: https://jaeger.dev.storj.io/trace/1bf9d891bdc9a83d FAIL (2026-03-11 14:25:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 25) ======LOGS====== Uploading piece... Mar 11 14:24:27.153062439 (123h24m24.749833476s) [noise=true , address=89.149.201.147:4006 , piece_id=ZKZAFGVZZYAWP2DGBUE6HT5LE2ACLOMFTRKICRAF5GD3LISFA6BQ, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.153554906 (123h24m24.750325935s) [noise=true , address=185.167.204.205:4024 , piece_id=Y4TM5PG4A6DNARD4O34BJSN6LMF4VT4ZHWXQUSBFZ5ZVBVY7KIWA, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.153671472 (123h24m24.750442505s) [noise=true , address=185.167.204.205:4008 , piece_id=2I5PABNWCYLBMFID4APRNOT3U5D6XUBTRVEC4YEO3777P3CGROXQ, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.154198573 (123h24m24.750969623s) [noise=true , address=81.171.14.70:4026 , piece_id=HNAGSNJFGU2ABDNJXDP6LHMLJM35L2SP4TWZA723Q3Y6XKX4FKMQ, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.154312252 (123h24m24.751083285s) [noise=true , address=185.167.204.206:4058 , piece_id=4NQYLKG4BBNIBIED4S2WCBM7TKBQYUALDTUKL52LVADRRJHZ4BYA, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.154809368 (123h24m24.751580398s) [noise=true , address=185.167.204.205:4036 , piece_id=P4335CKHCPCM4TAPGXYVBZSYNE5DGXBSTNGDQW3APOYF3ZHGYYKQ, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.154917240 (123h24m24.751688269s) [noise=true , address=89.149.201.147:4001 , piece_id=3FGKS7YT7IMKSPOPUXPJ3SGUP344N2LUPEDIDMPMVILLNSNOPOQA, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.155473342 (123h24m24.752244372s) [noise=true , address=185.167.204.205:4016 , piece_id=BTPYHEPALU5RPOHH4KWL4R7F3DKBVH4IZ5MITHUYHGS6J432MVTQ, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.155992320 (123h24m24.752763348s) [noise=true , address=185.167.204.206:4065 , piece_id=GGSNR3KYKQKS6KR7XJT5AEHN6SL44HQC254AYIIUI2MWDOPFFSLQ, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.159827080 (123h24m24.756598114s) [noise=true , address=89.149.201.147:4019 , piece_id=ZRDP3W4IRIBLI54FCXHDBGURZ7BDJRGU3RVNAHQ3KEIKKUY25C3Q, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.160873967 (123h24m24.757644999s) [noise=true , address=89.149.201.147:4016 , piece_id=TOHO2KTLGFBLE56EWGYX5HIDFBZQD5D5EC5ILCUH26KHFZT67XXA, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.162670731 (123h24m24.759441772s) [noise=true , address=185.167.204.205:4020 , piece_id=EXFP3ZU3PTOL5UCUHVLNRFT3WMRFXJHFZ47ZYPURMTZ7UOXC5HDA, seg_pos={0 0}, upload=138228]: Uploading piece... Mar 11 14:24:27.572494459 (123h24m25.169265472s) [upload=138228]: Next returned nil segment Mar 11 14:24:27.572509974 (123h24m25.169281s) [upload=138228]: Waiting for error group managing segments... Mar 11 14:24:27.743590233 (123h24m25.340361257s) [noise=true , address=81.171.14.70:4043 , piece_id=FR3HEZKQGJEVC4GLKPM4ZYZ5CGLCY6OE54UF33TOSJKCEK4JJPQA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.745963854 (123h24m25.342734878s) [noise=true , address=81.171.14.70:4026 , piece_id=HNAGSNJFGU2ABDNJXDP6LHMLJM35L2SP4TWZA723Q3Y6XKX4FKMQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.775766306 (123h24m25.372537389s) [noise=true , address=89.149.201.147:4006 , piece_id=ZKZAFGVZZYAWP2DGBUE6HT5LE2ACLOMFTRKICRAF5GD3LISFA6BQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.777750492 (123h24m25.374521515s) [noise=true , address=185.167.204.205:4008 , piece_id=2I5PABNWCYLBMFID4APRNOT3U5D6XUBTRVEC4YEO3777P3CGROXQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.800242692 (123h24m25.397013717s) [noise=true , address=185.167.204.205:4032 , piece_id=JXADS5JFYHJYA4LIZL7DTRHW4UCEG474BRM43K675UK52EDPCO5Q, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.803964517 (123h24m25.400735526s) [noise=true , address=81.171.14.70:4039 , piece_id=HMSKPSGQC3GZUAF2JLCTBV5UAQX7M5RRQX7DWOO6KQ2QLONN3O5Q, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.809065987 (123h24m25.40583701s) [noise=true , address=185.167.204.206:4062 , piece_id=IWSI7G5WD7KYI6KWXTGCJSURGHSE5QJY577XD65GQPUDOQWTUHWQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.821837085 (123h24m25.418608111s) [noise=true , address=89.149.201.147:4016 , piece_id=TOHO2KTLGFBLE56EWGYX5HIDFBZQD5D5EC5ILCUH26KHFZT67XXA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.827174281 (123h24m25.423945295s) [noise=true , address=185.167.204.205:4028 , piece_id=JVWM5IR4NX53VCCNFIY5KONQBWQ4BNJ5IARY3MIMT5XJWPJTV2QQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.835812398 (123h24m25.432583421s) [noise=true , address=185.167.204.205:4031 , piece_id=MMWMVRNCCGWTZIFHFWBFSFCYEIKXCGJYNOPA32ZFXTP4NKIEZUZQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.838663425 (123h24m25.435434448s) [noise=true , address=185.167.204.206:4061 , piece_id=3QY7RZCCSFQHX2U7YYZLC4KD2M7PN3HL32JJUKE4NWP4TU6SDEJA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.841212739 (123h24m25.437983987s) [noise=true , address=185.167.204.205:4017 , piece_id=AUMUXMOSL6KTREMYIUSTC5UUWJMCEHQOFRUAPSVHQF5EOJPC7TKA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.845886093 (123h24m25.442657131s) [noise=true , address=185.167.204.205:4006 , piece_id=JAL3U4DA22L72VJSFAKQXQNZY2FUT7HENXAMQJRKSV2EJLTJY4HQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.850526134 (123h24m25.447297161s) [noise=true , address=185.167.204.205:4020 , piece_id=EXFP3ZU3PTOL5UCUHVLNRFT3WMRFXJHFZ47ZYPURMTZ7UOXC5HDA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.852648615 (123h24m25.449419641s) [noise=true , address=89.149.201.147:4019 , piece_id=ZRDP3W4IRIBLI54FCXHDBGURZ7BDJRGU3RVNAHQ3KEIKKUY25C3Q, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.865503785 (123h24m25.462274808s) [noise=true , address=185.167.204.205:4024 , piece_id=Y4TM5PG4A6DNARD4O34BJSN6LMF4VT4ZHWXQUSBFZ5ZVBVY7KIWA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:27.974142636 (123h24m25.570913664s) [noise=true , address=185.167.204.205:4029 , piece_id=AVPIHNIJMEIDHDK5HACUAX63JUWEZMESYI5ZGNWDXZXOSYJJ6DPA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.019934062 (123h24m25.616705075s) [noise=true , address=185.167.204.206:4065 , piece_id=GGSNR3KYKQKS6KR7XJT5AEHN6SL44HQC254AYIIUI2MWDOPFFSLQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.087943951 (123h24m25.684714982s) [noise=true , address=185.167.204.206:4058 , piece_id=4NQYLKG4BBNIBIED4S2WCBM7TKBQYUALDTUKL52LVADRRJHZ4BYA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.130740465 (123h24m25.727511498s) [noise=true , address=89.149.201.147:4024 , piece_id=ADWLXAI5M745CV7CD7BA2OZ7BDYS32GHMJNKKVNIBR2K6QJBA6EQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.184384163 (123h24m25.781155195s) [noise=true , address=185.167.204.205:4016 , piece_id=BTPYHEPALU5RPOHH4KWL4R7F3DKBVH4IZ5MITHUYHGS6J432MVTQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.253566545 (123h24m25.85033757s) [noise=true , address=81.171.14.70:4031 , piece_id=IEEZQWNUZLILHKJE66QRYJM3VJ6XD32TBDH6LXD6LGB77K3IBUQQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.286655114 (123h24m25.883426138s) [noise=true , address=81.171.14.70:4029 , piece_id=K7GEYBFJPM57G7JE3VHAWRRG7TDF7HJRIRN5UQ44LXKDK6UFSGCQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.293584268 (123h24m25.890355294s) [noise=true , address=89.149.201.147:4014 , piece_id=V2ALNOE2LO6B5JVNU2NWPZYQWXTM7QQDU6HAVTAXQ6SA3FLSOOKQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:24:28.871996787 (123h24m26.46876781s) [noise=true , address=185.167.204.205:4036 , piece_id=P4335CKHCPCM4TAPGXYVBZSYNE5DGXBSTNGDQW3APOYF3ZHGYYKQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: <nil> Mar 11 14:25:26.740575069 (123h25m24.337346093s) [noise=true , address=89.149.201.147:4001 , piece_id=3FGKS7YT7IMKSPOPUXPJ3SGUP344N2LUPEDIDMPMVILLNSNOPOQA, seg_pos={0 0}, upload=138228]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:59576->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:25:26.740644103 (123h25m24.337415119s) [noise=true , address=185.167.204.205:4026 , piece_id=JACQLLWC3TJ4LYKJFDKIZS2EFZY43G6Q7UBIDE7UZZ2AZ6SS3TEQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: rpc: dial tcp 185.167.204.205:4026: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:25:26.740900686 (123h25m24.337671718s) [noise=true , address=89.149.201.147:4003 , piece_id=QFP2FLVYYS5IBQUU2ZHSD6EL7B4QMFSC7GDCPJN2BE257CWJ23SQ, seg_pos={0 0}, upload=138228]: Done uploading piece. err: ecclient: upload failed (node:134hab8xQdNGgLGN1nL6HZhXTX2Ysfi3zUdxbxEYmFjyZopqhX, address:89.149.201.147:4003): protocol: rpc: dial tcp 89.149.201.147:4003: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:25:26.740940279 (123h25m24.337711302s) [seg_pos={0 0}, upload=138228]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil> Mar 11 14:25:26.861714133 (123h25m24.458485148s) [upload=138228]: Done uploading segments... Mar 11 14:25:26.861783939 (123h25m24.458554974s) [upload=138228]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25) Duration: 1m0.124689139s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 480.050947ms trace: https://jaeger.dev.storj.io/trace/39b09b3dd50d8a9b FAIL (2026-03-11 07:01:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 480.151734ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 630.747969ms trace: https://jaeger.dev.storj.io/trace/39b09b3dd50d8a9b FAIL (2026-03-11 07:01:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 630.774026ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 460.014865ms trace: https://jaeger.dev.storj.io/trace/39b09b3dd50d8a9b FAIL (2026-03-11 07:00:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 460.051229ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 486.629179ms trace: https://jaeger.dev.storj.io/trace/39b09b3dd50d8a9b FAIL (2026-03-11 06:59:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.661084ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 439.741604ms trace: https://jaeger.dev.storj.io/trace/39b09b3dd50d8a9b FAIL (2026-03-11 06:58:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 439.765431ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)