Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 4.037996449s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:17:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.03809112s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.992917815s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:16:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.992947817s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.973618078s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:15:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.973650052s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.999618631s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:14:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.999659554s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.942746216s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:14:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.9427824s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.416892606s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:14:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.416927682s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 13.443976152s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:13:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 13.444005743s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 3.340272203s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:12:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.34030659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.215599841s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:11:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.215630613s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.177112528s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:10:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.177136695s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 35.599697246s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:10:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 35.599739664s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 12.076538833s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:09:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 12.076564179s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.203660814s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:08:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.203694985s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.543083622s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:07:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.543194764s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.947708897s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:07:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.947742634s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.944114819s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:06:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.944144214s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.030513293s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:06:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.03054427s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 11.869244205s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:05:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 11.869275566s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 44.397270371s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:05:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 44.397299879s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.487358541s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:03:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.487391564s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 33.106711985s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:03:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 33.106741202s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.602448195s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:02:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.602561381s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.935950655s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:01:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.935973165s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.274331796s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:01:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.274371535s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 15.514341269s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:01:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 15.514396369s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X.............................X.............................] duration: 2.085816147s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:00:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.085850905s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [XX.............................X............................] duration: 1.874899927s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:59:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.874933275s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.XX.............................X...........................] duration: 2.067537843s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:59:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.067582231s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..XX.............................X..........................] duration: 31.615994274s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:59:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 31.616057631s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...XX.............................X.........................] duration: 2.038655666s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:57:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.038770181s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....XX.............................X........................] duration: 2.201309084s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:57:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.201336498s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....XX.............................X.......................] duration: 29.513991276s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:57:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 29.514015948s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......XX.............................X......................] duration: 2.372228051s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:55:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.372255273s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......XX.............................X.....................] duration: 2.059087577s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:55:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.059183734s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [........XX.............................X....................] duration: 27.325687545s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:54:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 27.325718458s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.........XX.............................X...................] duration: 1.94557735s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:53:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.945613702s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..........XX.............................X..................] duration: 2.113444952s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:52:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.113473592s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...........XX.............................X.................] duration: 1.969792858s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:51:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.970585154s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [............XX.............................X................] duration: 2.213063086s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:51:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.213094566s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.............XX.............................X...............] duration: 25.850339941s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:50:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 25.850368759s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..............XX.............................X..............] duration: 3.410174037s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:50:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.410221588s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...............XX.............................X.............] duration: 2.187395038s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:49:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.187501089s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [................XX.............................X............] duration: 2.01010421s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:48:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.010132877s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.................XX.............................X...........] duration: 2.044697768s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:48:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.044729046s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..................XX.............................X..........] duration: 2.170286739s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:47:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.170329117s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...................XX.............................X.........] duration: 3.640090046s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:46:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.640139792s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....................XX.............................X........] duration: 1.958180764s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:45:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.958219063s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....................XX.............................X.......] duration: 1.953781629s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:45:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.953916615s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......................XX.............................X......] duration: 2.047579264s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:44:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.047729372s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX.............................X.....] duration: 1.902227851s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:43:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.902255579s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)