Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.602448195s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:02:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.602561381s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.935950655s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:01:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.935973165s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.274331796s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:01:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.274371535s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 15.514341269s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:01:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 15.514396369s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X.............................X.............................] duration: 2.085816147s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:00:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.085850905s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [XX.............................X............................] duration: 1.874899927s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:59:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.874933275s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.XX.............................X...........................] duration: 2.067537843s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:59:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.067582231s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..XX.............................X..........................] duration: 31.615994274s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:59:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 31.616057631s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...XX.............................X.........................] duration: 2.038655666s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:57:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.038770181s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....XX.............................X........................] duration: 2.201309084s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:57:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.201336498s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....XX.............................X.......................] duration: 29.513991276s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:57:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 29.514015948s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......XX.............................X......................] duration: 2.372228051s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:55:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.372255273s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......XX.............................X.....................] duration: 2.059087577s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:55:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.059183734s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [........XX.............................X....................] duration: 27.325687545s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:54:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 27.325718458s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.........XX.............................X...................] duration: 1.94557735s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:53:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.945613702s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..........XX.............................X..................] duration: 2.113444952s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:52:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.113473592s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...........XX.............................X.................] duration: 1.969792858s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:51:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.970585154s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [............XX.............................X................] duration: 2.213063086s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:51:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.213094566s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.............XX.............................X...............] duration: 25.850339941s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:50:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 25.850368759s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..............XX.............................X..............] duration: 3.410174037s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:50:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.410221588s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...............XX.............................X.............] duration: 2.187395038s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:49:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.187501089s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [................XX.............................X............] duration: 2.01010421s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:48:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.010132877s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.................XX.............................X...........] duration: 2.044697768s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:48:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.044729046s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..................XX.............................X..........] duration: 2.170286739s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:47:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.170329117s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...................XX.............................X.........] duration: 3.640090046s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:46:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.640139792s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....................XX.............................X........] duration: 1.958180764s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:45:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.958219063s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....................XX.............................X.......] duration: 1.953781629s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:45:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.953916615s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......................XX.............................X......] duration: 2.047579264s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:44:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.047729372s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX.............................X.....] duration: 1.902227851s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:43:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.902255579s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [........................XX.............................X....] duration: 1.995469358s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:42:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.995519374s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.........................XX.............................X...] duration: 1.946340759s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.946366659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..........................XX.............................X..] duration: 2.665669141s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.665817545s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...........................XX.............................X.] duration: 16.494171185s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 16.494240918s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [............................XX.............................X] duration: 1m1.540003607s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m1.540032145s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 1.96536993s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:39:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.96541262s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 4.408754241s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:38:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 4.408779416s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 1.945044387s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:37:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.945148968s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.390302882s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:37:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.390336626s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 2.018445474s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:36:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.018469067s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 2.088199172s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:35:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.088249413s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 3.562207435s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:34:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 3.562237303s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 2.022767426s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:33:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.022850145s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 1.976051786s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:32:41 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.976184483s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 2.226347305s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:32:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.226380044s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 2.290270077s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:31:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.290303711s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 27.995982282s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:31:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 27.996019283s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 1.974253713s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.974330522s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 1.931809299s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.93183874s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 45.154439448s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:03 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 45.154472378s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 3.770679065s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:27:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 3.770705796s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)