Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.055557508s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:18:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.055576485s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.060587734s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:18:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.060615705s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.15062154s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:17:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.150655704s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.132842324s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:16:52 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.132866126s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.029903803s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:16:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.029942062s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [X....X......................................................] duration:
2.039647406s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:15:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.039668605s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [.X....X.....................................................] duration:
2.125246587s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:14:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.125275422s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [..X....X....................................................] duration:
2.154207882s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:14:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.154323269s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [...X....X...................................................] duration:
2.11719969s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:12:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.117237309s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
2 out of 60 is failed (threshold=3) [....X....X..................................................] duration:
2.095230066s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:12:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.095276126s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [X....X....X.................................................] duration:
2.129050029s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:10:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.129086941s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [XX....X....X................................................] duration:
2.184243574s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:10:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.18428572s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.XX....X....X...............................................] duration:
2.105721429s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:09:26 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.105775532s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..XX....X....X..............................................] duration:
2.172373817s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:08:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.172411257s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...XX....X....X.............................................] duration:
2.526264333s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:07:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.526299945s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....XX....X....X............................................] duration:
2.103543176s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:06:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.103611121s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....XX....X....X...........................................] duration:
2.554250183s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:05:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.554387002s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......XX....X....X..........................................] duration:
2.109697409s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:05:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.109784314s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......XX....X....X.........................................] duration:
2.122055661s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:04:01 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.122092515s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........XX....X....X........................................] duration:
2.171172357s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:02:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.171202079s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........XX....X....X.......................................] duration:
2.150710042s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:02:41 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.150729813s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........XX....X....X......................................] duration:
2.245190905s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:01:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.245230274s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........XX....X....X.....................................] duration:
2.257416786s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:01:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.257450384s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............XX....X....X....................................] duration:
2.099737566s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 15:00:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.099785186s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............XX....X....X...................................] duration:
2.110883639s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:59:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.110912134s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............XX....X....X..................................] duration:
2.074479794s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:59:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.07450607s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............XX....X....X.................................] duration:
2.188836981s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:58:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.188857793s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................XX....X....X................................] duration:
2.122271815s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:57:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.122358848s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................XX....X....X...............................] duration:
2.104489007s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:56:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.104517338s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................XX....X....X..............................] duration:
2.159458038s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:55:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.15948489s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................XX....X....X.............................] duration:
2.172881304s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:55:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.172903837s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................XX....X....X............................] duration:
2.158272493s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:54:20 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.158295156s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................XX....X....X...........................] duration:
2.155823841s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:53:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.155868964s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................XX....X....X..........................] duration:
2.105310781s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:53:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.105340967s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.......................XX....X....X.........................] duration:
2.565636847s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:52:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.565689073s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [........................XX....X....X........................] duration:
2.148339812s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:51:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.148462917s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.........................XX....X....X.......................] duration:
2.103815877s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:50:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.103843762s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..........................XX....X....X......................] duration:
2.136748501s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:49:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.136776226s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...........................XX....X....X.....................] duration:
2.098381347s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:49:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.098409391s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [............................XX....X....X....................] duration:
2.13632648s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:48:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.136353925s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.............................XX....X....X...................] duration:
2.129497542s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:47:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.130296407s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..............................XX....X....X..................] duration:
2.177480284s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:46:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.177538673s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...............................XX....X....X.................] duration:
2.114109203s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:45:43 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.114141608s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [................................XX....X....X................] duration:
2.181358243s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:44:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.181384728s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.................................XX....X....X...............] duration:
2.09337966s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:44:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.093408897s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..................................XX....X....X..............] duration:
2.166810664s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:43:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.16683931s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [...................................XX....X....X.............] duration:
2.564722253s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:42:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.564747079s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [....................................XX....X....X............] duration:
2.165882676s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:41:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.16590873s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.....................................XX....X....X...........] duration:
2.252404801s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:41:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.252443262s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [......................................XX....X....X..........] duration:
2.092284248s trace:
https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0
FAIL (2026-03-11 14:40:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 24)
======LOGS======
ce...
Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece...
Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment
Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments...
Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil>
Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection
Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection
Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil>
Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments...
Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24)
Duration: 2.092311354s
core
uplink
eu-select-1
eu1-placement-15
|